Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Snap Deals #52

Merged
merged 37 commits into from
Jul 18, 2024
Merged

feat: Snap Deals #52

merged 37 commits into from
Jul 18, 2024

Conversation

magik6k
Copy link
Collaborator

@magik6k magik6k commented Jun 11, 2024

No description provided.

@magik6k magik6k force-pushed the feat/snap branch 3 times, most recently from 41bcbeb to 647cc99 Compare June 18, 2024 21:22
@magik6k magik6k force-pushed the feat/snap branch 3 times, most recently from 15f935b to 1a025aa Compare June 21, 2024 01:53
@magik6k magik6k marked this pull request as ready for review June 21, 2024 01:54
@magik6k magik6k changed the title [WIP] feat: Snap Deals feat: Snap Deals Jun 21, 2024
Copy link
Contributor

@LexLuthr LexLuthr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I did the first pass and major change I would recommend is proposal to Manifest conversion. I think we should do that in the last step and keep the metadata before that. Some important metadata like dealID and if deal is verified are hard to find otherwise.

documentation/default-curio-config.toml Outdated Show resolved Hide resolved
deps/config/types.go Outdated Show resolved Hide resolved
lib/tarutil/systar.go Outdated Show resolved Hide resolved
market/deal_ingest_snap.go Show resolved Hide resolved
lib/dealdata/dealdata.go Outdated Show resolved Hide resolved
tasks/snap/task_prove.go Outdated Show resolved Hide resolved
lib/asyncwrite/asyncwrite.go Show resolved Hide resolved
lib/fastparamfetch/paramfetch.go Outdated Show resolved Hide resolved
lib/ffi/sdr_funcs.go Outdated Show resolved Hide resolved
lib/ffi/snap_funcs.go Show resolved Hide resolved
web/static/upgrade/upgrade-sectors.mjs Outdated Show resolved Hide resolved
web/static/deals/pending-deals.mjs Outdated Show resolved Hide resolved
web/static/deals/pending-deals.mjs Outdated Show resolved Hide resolved
web/static/ux/curio-ux.mjs Outdated Show resolved Hide resolved
web/api/webrpc/deals.go Show resolved Hide resolved
@snadrus
Copy link
Contributor

snadrus commented Jun 26, 2024

Can you describe, maybe in a godoc:

  • how I get pieces into being Snapped vs Sealed?
  • What selects the grouping?
  • What triggers begin the snapping?

@magik6k magik6k force-pushed the feat/snap branch 4 times, most recently from 89e8ab9 to 984e092 Compare July 16, 2024 11:19
@magik6k
Copy link
Collaborator Author

magik6k commented Jul 16, 2024

how I get pieces into being Snapped vs Sealed?

This was missing, now is decided by the config

What selects the grouping?
What triggers begin the snapping?

Those two are the same as normal deal ingest

@magik6k magik6k force-pushed the feat/snap branch 2 times, most recently from f3161d6 to 10ecd79 Compare July 16, 2024 13:40
lib/dealdata/urlpiecereader.go Show resolved Hide resolved
lib/ffi/snap_funcs.go Show resolved Hide resolved
@magik6k
Copy link
Collaborator Author

magik6k commented Jul 18, 2024

Tested on my setup, appears to work well.

@magik6k magik6k merged commit 573e19d into main Jul 18, 2024
8 checks passed
@magik6k magik6k deleted the feat/snap branch July 18, 2024 12:42

shouldSeal := func(sector *openSector) bool {
// Start sealing a sector if
// 1. If sector is full
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

in what documentation is this reflected?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

iiuc docs for snap will be written soon

continue
}

// //////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////// TODO ADD SNAP SECTOR EXP CHECKS
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tracking bug for this TODO?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@@ -66,6 +66,8 @@ func (l *LMRPCProvider) WorkerJobs(ctx context.Context) (map[uuid.UUID][]storifa
}

func (l *LMRPCProvider) SectorsStatus(ctx context.Context, sid abi.SectorNumber, showOnChainInfo bool) (lapi.SectorInfo, error) {
// TODO: Add snap, Add open_sector_pieces
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tracking bug?

tasks/seal/task_sdr.go Outdated Show resolved Hide resolved
tasks/snap/task_encode.go Show resolved Hide resolved
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants