2020-09-16 conda-forge core meeting

Zoom link What time is the meeting in my time zone last weeks meeting

Attendees

  • CJ Wright

  • Geoffrey Garret

  • Filipe Fernandes

  • Uwe Korn

  • Keith Kraus

  • John Kirkham

  • Wolf Vollprecht

  • Cheng Lee

  • Sylvain Corlay

  • Anthony Scopatz

  • Matt Becker

  • Lori Burns

  • Eric Dill

  • Michael Sarahan

  • Isuru Fernando

  • Crystal Soja

  • Ray Douglass

Agenda

Standing items

  • [x] intros for new folks on the call

  • [x] (CJ) budget

    • current approvals?

    • First meeting of the month, screenshare and show the budget?

      • Link is in Keybase (numfocus_spreadsheets.txt)

Your new agenda items

  • [x] (UK) Kaleido PR

    • https://github.com/conda-forge/staged-recipes/pull/12093

    • Objections

      • Need to inspect dependencies and make sure they’re compatible with the rest of CF

      • Should build all of the non-chromium parts in CF

    • dynamically get chromium if it doesn’t find it

    • need licenses for all statically linked packages

    • shared libs with libstdc++ symbols might be an issue, check with ‘nm … | grep ” T “’

    • (Eric) TODO: Get a call set up with Jon Mease

      • scopatz, wolf, marcel

      • Uwe to comment on issue

      • (Isuru) they’re vendoring a lot of libraries in the wheel

  • [x] (CJ) Adding information to extras to state what the package provides as import names (for python packages). This will help with future inspection work.

    • https://github.com/regro/cf-scripts/blob/master/conda_forge_tick/pypi_name_mapping.py#L47

    • libcfgraph might have a list of the imports used inside of each library?

      • https://github.com/regro/libcfgraph/blob/master/artifacts/google-cloud-storage/conda-forge/linux-64/google-cloud-storage-1.24.1-py37_1.json

    • valuable to possibly call out who’s vendoring what

  • [x] (MB) Python 3.9 rc2 (final RC before release?) should be released around these days

    • Has anyone look at this yet? What’s to prepare?

    • Final release in about a month

    • (Crystal) Anaconda hasn’t gotten to it yet

    • (CJ) When 3.8 appeared, we didn’t prep at all. There were about 3-4 weeks of lead time before we were able to produce 3.9 packages

      • This is not true:

        • https://github.com/conda-forge/python-feedstock/pull/258

        • https://github.com/conda-forge/python-feedstock/pull/271

        • https://github.com/conda-forge/python-feedstock/pull/274

    • (Filipe) https://github.com/conda-forge/python-feedstock/issues/270

    • TODO: Should do the simplest thing first: open up a PR and see what fails.

      • Rebase the patches, if the patch doesn’t apply then open an issue about it.

      • Semi-related: How do we get our patches into the CPython code base?

  • [x] (MRB) @ggarrett13 has some interest in helping with vs2019 transition

    • What do we need to do to get this done?

    • (Isuru) Is this going to be global or just for a few feedstocks?

      • If it’s global, that’s going to be a bit of a problem. you can link libs with 2017 and 2019 together, but you need 2019 to do the linking. This will require people building conda packages locally to update to vs2019. Uwe was cross-compiling but we only have vs2017.

    • Which feedstocks need to be updated? Just the vc one

    • new universal runtime which adds new DLLs

      • not on windows 10

      • can download it from windows update

      • make a new runtime package

      • jjhelmus posted a note on the filename in gitter

      • try and use paul’s PR for vc for 2019

        • do that PR for 2017 and try it on vc_dev channel

        • then do for 2019

      • keep track of where version numbers come from

From last meeting

  • [x] (ED) Anything we need to discuss re: computer for Isuru?

    • Going to try the OVH cloud route for now.

    • We’ve approved this for up to 12 months for now.

    • TODO: Note that future spending proposals should include a TTL

  • [ ] (MRB) GCC 9.3.0 migration

    • I want to make sure I understand the list of things to do

    • we’ve built all of the compilers AFAIK

    • need to do a direct migration in the bot of the gfortran stack

    • do we want to change the libgfortran libs on linux to have the SO version in the library?

    • What am I missing?

  • [x] (MRB) github user @jan-janssen wants to list us in the “affiliated projects” section here https://pyiron.org/collaborators/

    • numfocus trademark guidelines are: “allow most uses as long as it is clear the person using the mark does not appear to be the project or endorsed by the project (without specific permission to do so)”

    • they say ultimately it is up to us

    • are we ok with this user displaying our logo and calling us an “affiliated project”?

      • enthusiastic yes!

    • PR for this: https://github.com/pyiron/pyiron.github.io/pull/77

  • [ ] (MRB) github docker images

    • AFAICT we cannot host public docker images on github unless we let anyone in conda-forge make images and push them

    • quote from docs (https://docs.github.com/en/packages/managing-container-images-with-github-container-registry/configuring-access-control-and-visibility-for-container-images#configuring-visibility-of-container-images-for-an-organization)

      • ‘For organization image containers, organizations admins must enable public packages before you can set the visibility to public. For more information, see “Enabling GitHub Container Registry for your organization.”’

      • (IF) - from the docs it looks like we can’t control them adding new packages, but we can control who have access to existing packages.

    • I tried pushing an image and could not make it public.

    • thus we need a separate org

    • I propose conda-forge-docker

Active votes

Subteam updates

Bot

ARM

POWER

CUDA

Docs

staged-recipes

website

security+systems

CI infrastructure

Compiler upgrade

CFEP updates

Open PRs

  • cfep-04 X11 and CDT policy

    • INACTIVE - Merge in with some inactive-esque status?

    • Needs new champion. Thanks for your work on this pkgw! Has unaddressed comments from pkgw as from Jan 10, 2020

  • cfep-06 Staged-recipes review lifecycle

    • INACTIVE - Merge in with some inactive-esque status?

    • Lingering comment from @saraedum. @jakirkham, can you reply? Has unadressed comment from @saraedum from Jan 8, 2020

    • (MRB) The stalebot has solved the worst of the issues here. I think we could defer this one permanently.

  • cfep-10 Feedstock statuses, unmaintained

    • INACTIVE - Merge in with some inactive-esque status?

    • Needs another review. Has unaddressed updates from pkgw as of Jan 11, 2020

  • cfep-12 Removing packages that violate the terms of the source package

    • Stalled since May 26, 2020

    • Active debate about moving to “broken” vs deleting from conda-forge channel

    • Active vote, ends on 2020-03-11

    • What were the results of the vote?

    • Did we hear back from NumFOCUS?

  • cfep-17 Handling pin backports and dependency rebuilds

    • Stalled debate about implementation details between Isuru, CJ and Matt

    • UPDATE 2020-07-22: We in principle have agreement to render the extra pinnings needed directly in the feedstock on a temporary basis (i.e., until the migration has ended).

Discussion

Check in on previous action items

Copy previous action items from last meeting agenda.

This meeting

2020-09-16

  • [x] Get a call set up with Jon Mease about the kaleido staged recipes PR

    • Emailed on 2020-09-16

  • [ ] (FF) Open up a PR on the python feedstock for python 3.9 and see what fails

Last meeting

2020-09-09

  • [ ] (ED) Update governance docs with similar voting model as what got put into conda-tools (+3 with no -1 is a pass)

  • [ ] (SC) Write jinja template to turn institutional partners yaml into a website https://github.com/conda-forge/conda-forge.github.io/blob/master/src/inst_partners.yaml

  • [ ] (SC) Document what needs to be done to create an OVH account and get access

2 meetings ago

Move to Issue Tracker

2020-08-26 Docker hub

  • [ ] (JK) Check in on Azure build workers to see if they have the docker hub limitation. Maybe Azure and docker hub

  • [ ] (JK) Check in on Azure build workers and see if they have the docker hub limitation

  • [ ] (JK) work with dockerhub to see if we can get OSS status

  • [x] (MRB) start pushing images to quay (https://github.com/conda-forge/docker-images/pull/152)

OVH

  • [ ] (???) build webpage to credit them (and others)

  • [ ] If we’re adding a logo, will want to make sure that we have permission to use it.

  • [ ] Shout-out on twitter at some point. “Thanks forOVHCloud for providing a VM”, etc. (maybe after we ship qt on windows with it?)

  • [ ] Figure out how to communicate breaking changes to users. Likely should open up an issue immediately for futher discussion. Ping @kkraus, plus capture notes from further up in these meeting notes

  • [ ] John K. will update the cuda toolkit feedstock on the git repo to note the NVBug link to the internal NVIDIA issue tracker

  • [ ] Jonathan will update docs to note that some non-exhaustive list of packages (like cuda-toolkit, MKL, etc.)

  • [ ] Jonathan will review this PR

  • [ ] (Kale) schedule conda working group

  • [ ] cfep-10 next steps: CJ to call a vote for feedback

  • [ ] cfep-06 next steps: Ask staged recipes team to champion this CFEP and move it forward

  • [ ] jakirkham & CJ-wright to sync on adding CUDA to the migration bot

  • [ ] (Eric) Scheduling Anaconda <-> conda-forge sync on anaconda.org requirements gathering

    • Will try and get this scheduled in the next month.

  • [ ] (Anthony) Reach out to NumFocus to figure out legal ramifications of not including licenses in files.

  • [ ] (Eric) check internally for funding levels for hotels & flying folks from the community in?

  • [ ] (Eric) Figure out finances of conda-forge to support themselves?

  • [ ] (jjhelmus) Open up CFEP for which python’s we’re going to support

  • [ ] (jakirkham) write a blog post on CUDA stuff we discussed today

  • [ ] (jakirkham) update docs on how to add CUDA support to feedstocks

  • [ ] (jakirkham) will open an issue on conda-smithy to investigate Drone issues. (ping the aarch team)

    • https://github.com/conda-forge/conda-forge.github.io/issues/954

  • [ ] (ED) Who we are page? Some combination of a FAQ and a who is everyone. FAQ things like:

    • who’s the POC for CF <> Anaconda, CF <> NumFocus, CF <> Azure

    • who’s the POC for the various subteams?

    • Informal information: roles, day jobs, bios, the whole nine yards, why you’re here, etc.

    • Public or internal? I don’t really care either way. Anyone feel strongly one way or the other?

    • opt-in to public bios

    • software carpentry has a large number of instructors and has https://carpentries.org/instructors

    • some concern about “yet another place to keep stuff up to date”

  • [ ] (ED) document strategies for reproducible environments using conda-forge

  • [ ] (UK) Static libraries stuff

    • [ ] Add linting hints to builds to find them

    • [x] Recommend how to package them -> CFEP-18

    • [x] We should write docs saying we don’t provide support and this is a bad idea. -> CFEP-18