-
Notifications
You must be signed in to change notification settings - Fork 44
Open
Labels
featureNew featureNew feature
Description
Feature Description (功能描述)
When we buffer write receiver's partition file to vertexFile
and edgeFile
maintained by FileGraphPartition
. We can implement parallel write.
Lines 75 to 87 in f7d10a8
public WorkerStat input() { | |
WorkerStat workerStat = new WorkerStat(); | |
this.recvManager.waitReceivedAllMessages(); | |
Map<Integer, PeekableIterator<KvEntry>> vertices = | |
this.recvManager.vertexPartitions(); | |
Map<Integer, PeekableIterator<KvEntry>> edges = | |
this.recvManager.edgePartitions(); | |
// TODO: parallel input process | |
for (Map.Entry<Integer, PeekableIterator<KvEntry>> entry : | |
vertices.entrySet()) { | |
int partition = entry.getKey(); |
JackyYangPassion and imbajin
Metadata
Metadata
Assignees
Labels
featureNew featureNew feature