Skip to content

JobVerificationEngine DAG construction (no driver assigned partition IDs), New Aggregate Integration #131

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 40 commits into from
Feb 9, 2021
Merged

JobVerificationEngine DAG construction (no driver assigned partition IDs), New Aggregate Integration #131

merged 40 commits into from
Feb 9, 2021

Conversation

andrewlawhh
Copy link
Collaborator

Refactor JobVerificationEngine removing trust from driver (no jobID assigned by driver)

  • Create graph based on input/output MACs.

Andrew Law and others added 27 commits October 1, 2020 18:14
Support for multiple branched CaseWhen
f17d8a8
@eric-feng-2011
Interval (mc2-project#116)
366e92c 
* add date_add, interval sql still running into issues

* Add Interval SQL support

* uncomment out the other tests

* resolve comments

* change interval equality

Co-authored-by: Eric Feng <[email protected]>
@chester-leung
Remove partition ID argument from enclaves
c7fcd98
@chester-leung
Fix comments
93dbf5e
@chester-leung
updates
f357ab2
@chester-leung
Merge serialization of ecall string as int
bb4018a
@chester-leung
Modifications to integrate crumb, log-mac, and all-outputs_mac, wip
56ace17
@chester-leung
Store log mac after each output buffer, add all-outputs-mac to each e…
21bbbfb 
…ncryptedblocks wip
@chester-leung
Add all_outputs_mac to all EncryptedBlocks once all log_macs have bee…
549566f 
…n generated
@chester-leung
Almost builds
55ee664
@chester-leung
cpp builds
057caec
@chester-leung
Use ubyte for all_outputs_mac
db54c44
@chester-leung
use Mac for all_outputs_mac
e77f1eb
@chester-leung
Hopefully this works for flatbuffers all_outputs_mac mutation, cpp bu…
736b8f6 
…ilds
merge
cbb2373
Merge branch 'comp-integrity' of https://github.com/mc2-project/opaque …
0351b5d 
…into comp-integrity
@chester-leung
Scala builds now too, running into error with union
3002bd3
@chester-leung
Stuff builds, error with all outputs mac serialization. this commit u…
dc54741 
…ses all_outputs_mac as Mac table
@chester-leung
Fixed bug, basic encryption / show works
5be9b7c
@chester-leung
All single partition tests pass, multiple partiton passes until tpch-9
86fab02
@chester-leung
All tests pass except tpch-9 and skew join
8b1a1d1
@chester-leung
comment tpch back in
18f45d6
Merge branch 'crumb-path' of http://github.com/chester-leung/opaque i…
123fa1f 
…nto comp-integrity
Check same number of ecalls per partition - exception for scanCollect…
bfc06ba 
…LastPrimary(?)
First attempt at constructing executed DAG
c818a41
Fix typos
39a4945
Rework graph
c970965
@andrewlawhh andrewlawhh changed the title Comp integrity JobVerificationEngine DAG construction (no driver assigned partition IDs) Dec 14, 2020
Andrew Law added 2 commits December 14, 2020 17:35
@andrewlawhh andrewlawhh self-assigned this Feb 2, 2021
wzheng
wzheng reviewed Feb 3, 2021
View reviewed changes
Copy link
Collaborator

@wzheng wzheng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Partial review

chester-leung
chester-leung reviewed Feb 3, 2021
View reviewed changes
Copy link
Member

@chester-leung chester-leung left a comment •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you also delete the commented out print statements / old code? I left comments at some places but not all.

@andrewlawhh andrewlawhh merged commit a95f2c7 into mc2-project:comp-integrity Feb 9, 2021
@andrewlawhh andrewlawhh changed the title JobVerificationEngine DAG construction (no driver assigned partition IDs) JobVerificationEngine DAG construction (no driver assigned partition IDs), New Aggregate Integration Feb 9, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@wzheng wzheng wzheng left review comments

@chester-leung chester-leung chester-leung approved these changes

Assignees

@andrewlawhh andrewlawhh

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@andrewlawhh @wzheng @chester-leung @eric-feng-2011