Skip to content
This repository has been archived by the owner on Feb 8, 2023. It is now read-only.

Sprint: February 1 #88

Closed
RichardLitt opened this issue Feb 1, 2016 · 29 comments
Closed

Sprint: February 1 #88

RichardLitt opened this issue Feb 1, 2016 · 29 comments

Comments

@RichardLitt
Copy link
Member

Sprint February 1st

Sprint Goals

Sprint Discussions

Schedule

Note: There is no libp2p talk this week, so we've moved go-ipfs up

Please take notes in a separate pad, if you can, and link it here.

Endeavour Lead Time (PDT - UTC/Z - CET) Pad
sync Rich Littauer 9:00pDT 17:00Z 18:00CET IRC: #ipfs on Freenode
apps on ipfs Friedel Ziegelmayer 10:30PDT 18:30Z 19:30CET https://public.etherpad-mozilla.org/p/ipfs-feb-1-apps-on-ipfs
infrastructure Lars Gierth 11:00PDT 19:00Z 20:00CET https://public.etherpad-mozilla.org/p/ipfs-feb-1-infrastructure
go-ipfs Jeromy Johnson 11:30PDT 19:30Z 20:30CET https://public.etherpad-mozilla.org/p/ipfs-feb-1-go-ipfs
js-ipfs David Dias 12:00PDT 20:00Z 21:00CET https://public.etherpad-mozilla.org/p/ipfs-feb-1-js-ipfs

Please add the Agenda to the Pad before the endeavour sprint starts.

Sprint Deliverables

  • Add your tasks below in a comment, that way we only have people listed who are really in the sprint
  • Add links to issues down here. Only add things you can finish this sprint.
@dignifiedquire
Copy link
Member

Apps on IPFS

Lead: @dignifiedquire

Participants

Agenda

  • registry-mirror
  • removing a lot of technical debt (from glue code to actual code)
  • adding more features (the requested ones)
  • making it nicer to contribute (more proper testing!)
  • webui
    • lots of research cumulating in starting to use redux + redux-saga (no more setInterval soon)
  • distributions
    • new version with fixed containing folder

Notes

Registry Mirror

  • diasdavid is working on a big code refactoring
  • Daemon in biham died and hung, still need to do research into why
  • new features:
    • logging the root hash from time to time, to help with debugging and crashes
    • remove different blob stores (part of the refactor) we just use ipfs
    • if statements --
  • Adding debug logs for api requests, to easier figure out which commands fail

Webui

  • research -> redux + redux-saga
  • short demo of redux-devtools
  • TODO: migrate ipfs-geoip data to 0.4
  • TODO: make progress on the migration to redux

Distributions

  • new version with containing folder fix

@daviddias
Copy link
Member

IPFS implementation in JavaScript

Lead: David Dias

Participants

Agenda

  • update
  • js-ipfs-blocks
  • js-ipfs-merkle-dag
  • js-ipfs-data-importing (managed to import a file)
  • this week focus
  • js-ipfs object
  • js-ipfs files add
  • js-ipfs-bitswap
  • other things that can be done

@ghost
Copy link

ghost commented Feb 1, 2016

Infrastructure

Lead: @lgierth

Participants

Agenda

Notes

  • 0.4.0
    • blog post about the migration /cc richardlitt
    • pinbot
      • ipfs-shell => go-ipfs-api
  • docker & gx
    • with gx, the dependencies are no longer within the source tree, but instead in GOPATH
    • build outside docker and just copy the ipfs daemon in?
    • an export/import step at the end to get rid of intermediary images?
  • testing
  • pages deploy
    • multipublish tool /cc jbenet
  • ipns perf
  • TODO RIGHT NOW
    • publish dist
    • publish website

@RichardLitt
Copy link
Member Author

To Do

  • Sprint Management
  • Write the weekly roundup
  • IPFS API
    • cat
    • commands
    • config
    • daemon
    • dht
    • diag
    • dns
    • file
    • get
    • id
    • init
    • log
    • ls
    • version

@whyrusleeping
Copy link
Member

go-ipfs

go-go-ipfs

Lead: @whyrusleeping

Participants

Agenda

  • gx vendoring
  • files hang debugging
  • take a look at suspected memory leaks
  • multistream seems to have some goroutine issues
  • going through issues, gonna try and triage most of them
  • files api inotify
  • swarm peers notify
  • improvements to 'ipfs mount'

You have 30 minutes for this agenda, 5 minutes before the meeting ends, consider moving the remaining items to a github discussion thread so that all the other sprint meetings can start in time.

Notes

After sprint meeting is finished, create the respective action items on the Github sprint issue

@whyrusleeping
Copy link
Member

you know, i didnt add that gif in there. but i'm also not gonna remove it

@RichardLitt
Copy link
Member Author

i did it was me

@whyrusleeping
Copy link
Member

  • 'verbose' mode for some commands to help debugging
  • debug files api hangs
    • add tests for this too
  • debug random multistream goroutines...
    • too many goroutines open in yamux Read wait
    • likely an issue with readHandshake in go-multistream. (too many goroutines waiting)
  • modtimes in files api
  • fuse mount code as separate binary
    • files api as fuse mount
  • private networks
    • implement 'encrypted transport' thing
  • directory sharding?
  • node aliases (should be easy to add to config)
    • keep map in IpfsNode object, maybe in resolver too
  • progress bar lib
  • gx
    • writeup
    • command polishing

@daviddias
Copy link
Member

DAVID DIAS TODO

@hackergrrl
Copy link
Contributor

noffle todo

@Kubuxu
Copy link
Member

Kubuxu commented Feb 2, 2016

Kubuxu todo:

@dignifiedquire
Copy link
Member

@dignifiedquire todo

  • Redux and the webui

@rht
Copy link

rht commented Feb 2, 2016

Can someone on go-ipfs look over and merge ipfs/kubo#2100, ipfs/kubo#2120, ipfs/kubo#2205, ipfs/kubo#2221, ipfs/kubo#2251 (in particular the last one)?

@whyrusleeping
Copy link
Member

hey @rht, mind posting your weekly TODO's here too? It would help us get a better idea what everyone is working as a group and makes planning easier. (also posting an update at the end of the sprint cycle is super helpful!)

@ghost
Copy link

ghost commented Feb 4, 2016

@lgierth todo

  • 0.4.0
    • [~] update pinbot
    • update dockerfile for libp2p/gx
    • automated docker image jbenet/go-ipfs => ipfs/go-ipfs
    • [~] figure out grace period for jbenet/go-ipfs image
  • infrastructure
  • ops
  • whislist
    • proposal for simpler website deployments

@rht
Copy link

rht commented Feb 4, 2016

hey @rht, mind posting your weekly TODO's here too?

Figure a way to properly fix bitswap duplicate blocks. I don't think this issue is present in torrent.

@rht
Copy link

rht commented Feb 4, 2016

pin & pin & pin [& pin ...]

How should this be parsed?

@ghost
Copy link

ghost commented Feb 4, 2016

How should this be parsed?

Sorry this should have been clearer: I had trouble pinning dist and website, the pin would eventually succeed, but the CLI hung forever.

@rht
Copy link

rht commented Feb 4, 2016

ic, I think this can be consistently reproduced with running the daemon with auto-gc enabled, with sufficiently low GCPeriod such that added blocks get gc-ed before the pinning starts. (I mean, this should be put in test)

@rht
Copy link

rht commented Feb 4, 2016

ic, the issue is in the CLI, but the pin completes just fine?

@whyrusleeping
Copy link
Member

please move discussion to a relevant issue elsewhere, this issue is just for task tracking.

@hackergrrl
Copy link
Contributor

noffle sync update

Lots of reading and thinking about records, freshness, and how the record routing layer will fit into IPFS. Started some discussions around 'ipfs mount' and app-layer pubsub. Big progress on improving fuse UX!

@RichardLitt
Copy link
Member Author

To Done

Mostly lots of API stuff this week; also, tons of docs for go-ipfs.

  • Sprint Management
  • Write the weekly roundup
  • IPFS API
    • cat
    • commands
    • config
    • daemon
    • dht
    • diag
    • dns
    • file
    • get
    • id
    • init
    • log
    • ls
    • mount
    • name
    • object
    • pin
    • ping
    • refs
    • repo
    • resolve
    • stats
    • swarm
    • tar
    • tour
    • update
    • version

Extra

@ghost
Copy link

ghost commented Feb 8, 2016

@lgierth sync update

I started off the week with blog and dist deployments, which were a bit hairy because pinning was/is buggy and tended to hang indefinitely. The gx dependencies support for the go-ipfs docker image took me a bit longer than I expected but it does work nicely now.

@whyrusleeping
Copy link
Member

  • 'verbose' mode for some commands to help debugging
    • getting pretty close to finishing this, pretty useful already
  • debug files api hangs
    • all the hangs i was previously seeing are accounted for
    • still an issue with 'too many open files' causing a block to be lost
  • debug random multistream goroutines
    • didnt get time to look at this
  • shipped gx ipfs PR. Woo! ⭐
  • wrote tool to publish ipns records without the ipfs daemon 🌟
    • also a tool to generate private keys as needed to use with said tool
  • gx cleanup, fixed an issue that was reported and modified some UX after feedback in irc

@daviddias
Copy link
Member

David Dias Check in

js-ipfs
api documentation
js-ipfs-api
libp2p
npm on ipfs
extra

@dignifiedquire
Copy link
Member

@dignifiedquire Sprint Update

Webui

Distributions

JS IPFS API

Misc

@jbenet
Copy link
Member

jbenet commented Feb 8, 2016

@jbenet update

My last week has been spent primarily in important meetings with people, discussing IPFS and other protocols. I had very little time for code or review. If i'm blocking something major, please ping me on IRC or here with what you need review on. (Sorry @whyrusleeping and @rht for go-ipfs laggg)

  • a TON of meetings about IPFS
  • NYU mazieres talk
  • tested out ipfs-update in prep for 0.4.0 (found UX bugs)
  • reviewed / improved weekly
  • iprs / records / dht discussion with @noffle
  • ICT related work

@Kubuxu
Copy link
Member

Kubuxu commented Feb 8, 2016

Kubuxu update:

@jbenet jbenet removed the sprint label Feb 11, 2016
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
8 participants
@jbenet @rht @hackergrrl @dignifiedquire @RichardLitt @daviddias @whyrusleeping @Kubuxu