2019-10-30 conda-forge core meeting¶
Attendees¶
Eric D.
Marcel
Filipe
Jonathan
Sophia C.
John K.
Dougal
Marius
Mike S.
CJ
Lori
Agenda¶
Your agenda items¶
(Eric) What’s everyone going to be for Halloween?
Game of Thornes end episode writter (Filipe)
(Eric) Scheduling a time that’s more convienent for folks in other time zones. Quick vote and I’ll schedule it
10:00 UTC (6:00 EDT)
12:00 UTC (8:00 EDT)
17:00 UTC (13:00 EDT) (current meeting time)
We don’t need to reschedule to accomodate. Filipe wanted to accomodate some others in other time zones but they’ve sort of disappeared
(Filipe) Discussion NumFOCUS PEX cards. Do we need it? Should we order one?
Opinion: we should avoid these and just do better planning. Worst case
What about recurring costs? For recurring costs, NumFocus can pay these for us so we should plan ahead and get them to do that.
Conclusion: Better planning.
(Filipe) Updated on the new SGD submission.
Small Grants Development (SGD)
to foster some work on conda-skeleton and regenerating recipes. This is to do what bioconda folks are already doing. This will help us be better about dependency tracking and metadata updates
Filipe is planning on paying someone to do this work (Marcelo Trevisani)
(Filipe) Strategies to catch up with Qt releases.
(Isuru) Qt 5.12 is an LTS release with EOL in Dec 2021. This is what is packaged in conda-forge.
(Isuru) Qt 5.13 is a regular release with EOL in one year usually. (June 2020)
We should be building Qt more regularly. How do we achieve this? Provisioning Windows Azure VMs seems like the best path forward.
We’d need to make an Azure org (or whatever their term is) and then distribute credentials
We should consider talking to Microsoft about help doing this on Azure.
Marius will run point on these conversations this week at NumFocus Summit and PyData.
Get updates from Marius at next dev meeting.
(CJ) Any NumFOCUS summit things: (from NumFOCUS) We ask that our more senior projects come prepared to briefly share any recent project news or experiences that would be of value for others to learn about. Things like:
Funding successes or failures
Major governance changes and their impact
Initiatives taken to increase diversity and inclusion in your project and their results
Any experiences that other projects could learn from
(Eric) Send out email to conda-forge group asking for feedback on these points.
(CJ) pydata nyc lightning talk for CF, Tom asked for a short something
Anthony said he’d take this
(John) Aligning on GPU packages between CF and defaults
NCCL
(pronounced: Nickel)
Defaults is still on 1
Will likely update when one of our deps needs it.
Many things don’t work without 2 (or even newer)
Now in CF at version 2.4
CuPy
Recently added to conda-forge
PfN (Preferred Networks) taking over maintenance of the feedstock
Defaults is still on 6.0.0 (latest is 6.5.0)
Building is really hard on windows and this is what the hold-up is on the Anaconda side.
xgboost
Currently CPU only in conda-forge
Would like to add GPU builds to conda-forge
https://github.com/conda-forge/xgboost-feedstock/issues/26
Selection between CPU/GPU can be simplified
https://github.com/conda-forge/xgboost-feedstock/issues/23
https://github.com/conda-forge/xgboost-feedstock/pull/35
ppc64le and aarch64
Currently no aarch64 cudatoolkit packages
ppc64le cudatoolkit packages out-of-date (currently at 9.0)
Anaconda would have much more success getting newer packages out if the recipe was updated – the holdup is finding where all the shared libraries moved to.
NVIDIA Docker images exist for ppc64le
NVIDIA Docker images in the works for aarch64
(Marius) Kubernetes build update
Can build cupy on a transient kubernetes gpu cluster.
Preliminary results feel positive.
maybe we have blog post #2 right here?
All of this work is happening on GKE. Would be good to try and get this ported over to Azure, maybe.
(CJ) Should conda-forge ship ARM / aarch64 conda-forge miniconda installers?
Anaconda builds ppc packages and provides anaconda / miniconda installer
Should conda-forge build these?
There’s no one on this conda-forge call that actually wants to own the maintenance burden of this.
(Filipe) Python 3.8 made it to defaults
(Mike): “sort of” made it to defaults. We only have py3.8 available right now.
Subteam updates¶
Bot¶
(CJ) ROS (robot operating system) integrated with auto tick bot (mostly, they didn’t jinja2 their urls causing problems)
(CJ) The bot now handles multi-output recipes properly, should make migrations go better
(CJ) CircleCI run URLs are now in bot commits, and comments making debug easier
ARM¶
Docs¶
staged-recipes¶
website¶
CI infrastructure¶
Compiler upgrade¶
CFEP updates¶
How do we start getting traction on these?
cfep-03 Manual upload of builds¶
cfep-04 X11 and CDT policy¶
cfep-05 dev/rc builds¶
(Eric) I think there’s been some discussion on cfep-05 recently. Maybe @cj can give us an update
(CJ) I think the main stall here is if we can get
.../label/rc/matplotlib
to be a valid anaconda.org path(CJ, John K.) also are dev labels provided on a per package or per feedstock level (should we have a
.../rc/gdal
and.../rc/libgdal
)(Eric) We should implement this in whatever way is as simple as possible for the conda-forge tooling ecosystem. If there is enough of sentiment that they want
cfep-06 Staged-recipes review lifecycle¶
cfep-08 Too Big To Fail¶
cfep-10 Feedstock statuses, unmaintained¶
Discussion¶
Check in on previous action items¶
Copy previous action items from last meeting agenda.
Last meeting¶
[ ] (Filipe) CFEP-03: Review, fix any text and merge it in.
Minor updates that are needed. This will likely get done in December.
[ ] (CJ) CFEP-08: Merge in with deferred status
Will check in next meeting.
2 meetings ago¶
3 meetings ago¶
[ ] (Eric) Email out to see if we can get more engagement on regular dev meetings.
[x] (Sophia) Set up meeting to talk about Condafile stuff.
Will punt on this until she’s working on this actively again
[x] (Filipe) Ping Bjorn to try and get Debian community more involved with conda-forge
Going to drop this from our tracker
[ ] (Eric) Scheduling Anaconda <-> conda-forge sync on anaconda.org requirements gathering
Will try and get this scheduled in the next month.
[ ] (Anthony) Reach out to NumFocus to figure out legal ramifications of not including licenses in files.
4 meetings ago¶
[x] (Filipe) Progress on setting up a self-hosted blog
Medium seems to be generally downvoted
Host your own blog seems to be generally positive
Can we mimic what Dask does for their dev blog? https://github.com/dask/dask-blog
Moved to github issue https://github.com/conda-forge/conda-forge.github.io/issues/916
[x] (Needs Owner) Searching on our website is a little difficult
[x] (Filipe, Anthony) Improve docs on releasing conda-smithy. Currently says “use rever”. Would be good to fill out more info there for those of us that are unfamiliar with rever.