Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
Y
YCSB
Manage
Activity
Members
Labels
Plan
Issues
0
Issue boards
Milestones
Wiki
Code
Merge requests
0
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Build
Pipelines
Jobs
Pipeline schedules
Artifacts
Deploy
Releases
Model registry
Operate
Environments
Monitor
Incidents
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
Adnan Ahmad
YCSB
Commits
0350c37e
Commit
0350c37e
authored
7 years ago
by
Kevin Risden
Committed by
GitHub
7 years ago
Browse files
Options
Downloads
Patches
Plain Diff
[s3] Use AWS IOUtils to read object data (#1021)
parent
d69345fc
No related branches found
Branches containing commit
No related tags found
No related merge requests found
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
s3/src/main/java/com/yahoo/ycsb/db/S3Client.java
+2
-8
2 additions, 8 deletions
s3/src/main/java/com/yahoo/ycsb/db/S3Client.java
with
2 additions
and
8 deletions
s3/src/main/java/com/yahoo/ycsb/db/S3Client.java
+
2
−
8
View file @
0350c37e
...
...
@@ -28,6 +28,7 @@ import java.util.*;
import
java.util.concurrent.atomic.AtomicInteger
;
import
java.net.*
;
import
com.amazonaws.util.IOUtils
;
import
com.yahoo.ycsb.ByteArrayByteIterator
;
import
com.yahoo.ycsb.ByteIterator
;
import
com.yahoo.ycsb.DB
;
...
...
@@ -427,14 +428,7 @@ public class S3Client extends DB {
Map
.
Entry
<
S3Object
,
ObjectMetadata
>
objectAndMetadata
=
getS3ObjectAndMetadata
(
bucket
,
key
,
ssecLocal
);
InputStream
objectData
=
objectAndMetadata
.
getKey
().
getObjectContent
();
//consuming the stream
// writing the stream to bytes and to results
int
sizeOfFile
=
(
int
)
objectAndMetadata
.
getValue
().
getContentLength
();
byte
[]
inputStreamToByte
=
new
byte
[
sizeOfFile
];
int
len
;
int
offset
=
0
;
while
((
len
=
objectData
.
read
(
inputStreamToByte
,
offset
,
sizeOfFile
-
offset
))
>
0
)
{
offset
+=
len
;
}
result
.
put
(
key
,
new
ByteArrayByteIterator
(
inputStreamToByte
));
result
.
put
(
key
,
new
ByteArrayByteIterator
(
IOUtils
.
toByteArray
(
objectData
)));
objectData
.
close
();
objectAndMetadata
.
getKey
().
close
();
}
catch
(
Exception
e
){
...
...
This diff is collapsed.
Click to expand it.
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment