You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As a community service we could offer online tutorials hosted by one of the Dask maintainers.
The tutorial at https://tutorial.dask.org was designed to run in a three-to-four hour period (for SciPy). We could offer this, or some stripped down version of it as an online web video call. Hopefully it's relatively straightforward to deliver, and also a good learning experience for those involved in giving it.
My hope is that as more of us deliver this tutorial we then are able to refine and improve the tutorial over time. Preparing, delivering, and then tuning the tutorial afterwards would, I think, be a high value maintenance activity. I think that we may have the bandwidth to start delivering the tutorial somewhat regularly.
Reacted by Willi Rath, Jacob Tomlinson and Pavithra Eswaramoorthy
We could try using Twitch and/or YouTube streaming for this, that way they can be archived afterwards and watched back later. Many conferences that have moved online are using these services and it seems to work quite well.
I've been experimenting this week with streaming bits of my open source maintenance work on Twitch and it was pretty easy to get started.
This sounds fun.
One question around infrastructure & format though: do you envision
attendees following along live and running the examples, asking questions,
etc.?
In the past we've temporarily set up a cluster with jupyterhub & Dask so
that attendees could play with a real cluster. Would we attempt the same
thing here, or would we just have attendees run things locally?
My only concern is around who would pay for the cluster computing
resources. I'm not too worried about the technical side of things. It's
pretty easy to set up a Jupyterhub & Dask Gateway on a kubernetes cluster
these days.
Tom
On Fri, May 22, 2020 at 4:18 AM Jacob Tomlinson ***@***.***> wrote:
We could try using Twitch and/or YouTube streaming for this, that way they
can be archived afterwards and watched back later. Many conferences that
have moved online are using these services and it seems to work quite well.
I've been experimenting this week with streaming bits of my open source
maintenance work on Twitch and it was pretty easy to get started.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
<#57 (comment)>, or
unsubscribe
<https://github.com/notifications/unsubscribe-auth/AAKAOIUNTKJ62G3V3XOG4FTRSY7MTANCNFSM4NG6DARQ>
.
It seems like there are two approaches to video tutorials
Broadcast with twitch/youtube
Video conference
I think that they're both useful. It seems like twitch/youtube support more viewers, but don't allow for as much engagement. My guess is that they're better if we're doing new content every time. Video conferencing might be better if we have smaller groups (say 10-20) where the students are going through exercises on their own and being coached by community members. This seems better to me if we do the standard tutorial on a regular basis.
My only concern is around who would pay for the cluster computing
resources
I think that the Dask/NumFOCUS account could be used if we're looking at something in the few hundred dollars range.
In the past we've temporarily set up a cluster with jupyterhub & Dask so
that attendees could play with a real cluster. Would we attempt the same
thing here, or would we just have attendees run things locally?
I recently gave the tutorial using the binder setup at tutorial.dask.org, and found it good enough to teach people how dask works and how to think about it. Yes, they didn't get a real "distributed" cluster, but they still got to see how dask's api works and learned how to reason about the various concepts.
@mrocklin yeah I agree with that assessment. I think Twitch/YouTube would be good for doing something like a talk. Especially if the recording would be useful afterwards. But then video conference would be good for a more workshop style session.
If we have human resources, I'm inclined to try both and see what engages people.
If I were to organize this I would suggest the following:
We schedule two online tutorials, one for two weeks from now and one for two weeks following. We get suckers volunteers to sign up to deliver these.
On alternating weeks we also get a couple of people to sign up to give a Twitch-style talks about some topic like "all the ways to deploy Dask on Kubernetes" or "How to use Dask with Xarray"
On Fri, May 22, 2020 at 11:32 AM Matthew Rocklin ***@***.***> wrote:
If we have human resources, I'm inclined to try both and see what engages
people.
If I were to organize this I would suggest the following:
1. We schedule two online tutorials, one for two weeks from now and
one for two weeks following. We get suckers volunteers to sign up to
deliver these.
2. On alternating weeks we also get a couple of people to sign up to
give a Twitch-style talks about some topic like "all the ways to deploy
Dask on Kubernetes" or "How to use Dask with Xarray"
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<#57 (comment)>, or
unsubscribe
<https://github.com/notifications/unsubscribe-auth/AAKAOITRC2VBAXE2B3HDGVLRS2SIBANCNFSM4NG6DARQ>
.
If your Czar duties are tracking dask/distributed then I'm happy to do
extra work to allow you to go be a sucker on this one :) I'm excited to
see if this is something that we can start doing regularly.
From when you sent that message that would be Friday the 5th of June.
Do you have thoughts on a time? I wonder whether we should try and do it at a time like 2pm, which would be practical for folks in immediately neighbouring timezones. Perhaps trying to alternate the presenter between continents week-to-week to be as inclusive as possible.
I think that we'll want at least a weak of lead time to advertise and prep. +1 on switching around time zone availability to support a broad set of attendees.
Ok given that time is passing I suggest we go for Friday June 12th at 1pm UTC. That'll be 9am east coast US, 2pm for me and 3pm central Europe, so should have good coverage. I also suggest we pencil in 90 minutes for it.
Then maybe next time someone in North America could run it to get coverage for west coast?
I think we should also use Zoom for this first one. Do we have access to a Zoom pro account for avoiding the time limit and doing recordings?
@mrocklin are you able to coordinate promoting it?
I taught a 4-hour workshop on oreilly.com focused on Dask Dataframes and teaching it again at the end of July. It alternates between lecture/exercise. May be up for doing a volunteer teaching session or integrating these into the docs. Here's a link to the notebooks: https://github.com/dgerlanc/dask-scaling-dataframe.
Hi! I attended this morning. Jacob and Matthew - great job!!!! I really appreciated the time and preparation you put into the tutorial.
I think it is interesting to re-imagine what a tutorial is, given that I was still in my PJs and no one knew. My commute was 10'. So, if we all aren't expending the effort to travel to a similar location, then there really isn't any need to meet for an extended period of time. I found Jacob walking us through the tutorials to be really interesting. I wish that it was about 50% slower and I wanted him to spend more time describing Dask and how it was being used, or what functions might be interesting to use here, or his thought process about how he uses these tools for different types of problems and how he troubleshoots/finds solutions.
While tutorials traditionally have show code / do code / repeat structure, I didn't find the coding part as useful during the tutorial. I want to try out the code, but I can do that on my own.
I also really liked reading the chat & response. It worked well to have Jacob focus on the tutorial and Matthew on the chat. I think it would have made it a little more interactive to have Jacob pause every so often & have Matthew answer a chat verbally or have a short conversation with the person who posted. Yes, this will slow things down, but this is why we are all attending -- there are lots of tutorials we can do online or by ourselves, I wanted to hear from Jacob/Matthew how they used Dask and have more of a conversation.
It almost seemed like it would be useful to break up the tutorial into much smaller bits and just do them more frequently.
Again, great job. This was really useful and I hope to see more in the future. I'd love to see how this works on twitch or other platforms.
This looks very nice! For some reason the YouTube video definition is 360p maximum (which makes it hard to read the text of the notebook) but maybe it is just YouTube that takes some time to upload higher resolution videos.
I think that the plan is for @jacobtomlinson to write up the process that we used into a blogpost. Then hopefully @martindurant + someone else will use this plan to run through the process two weeks from now, hopefully at a time that is more convenient for US folks, especially on the west coast.
Additionally on the Pangeo call today I mentioned that it would be fun to repeat this process for other Dask-adjacent projects. I think that Xarray would be a good first candidate for this. @andersy005 said that he felt comfortable volunteering for this.
Reacted by Anderson Banihirwe, Jacob Tomlinson and Sebastian Alvis
Thank you, @martindurant! What does your schedule look like? I am thinking we could schedule the first session around Friday, Oct 2? @dcherian, would you be interested in join us?
For some reason the YouTube video definition is 360p maximum (which makes it hard to read the text of the notebook)
@jacobtomlinson, do you happen to know the exact root cause for the low quality recording? Do you have any recommendations for addressing this issue?
Also,
Zoom worked ok and had some tools for user feedback. However it felt more like a 50 person meeting than a presentation so something like a YouTube livestream may be better in future.
I am curious to know how the subsequent tutorials (after the first one) were delivered. Did you use Zoom again? How was the overall experience? Are there any recordings on YouTube? What are your thoughts on Youtube Livestream? I am thinking of using unlisted Youtube Livestream for the upcoming xarray tutorial since I don't have access to a Zoom pro account.
Yes, we used zoom, without any special effects - so the quality was totally fine. I believe the low quality before was to do with the use of OBS. You can screen-share and record the speaker and/or gallery (this with a licensed account). I didn't post the recording, being so similar to the previous tutorial. For some reason, the feedback buttons were missing from the chat on my session, that was the only annoyance, but I'm not sure I would have used them.
(I can, of course, provide a zoom room, if that makes life easier)
Yes, we used zoom, without any special effects - so the quality was totally fine.
👍
I can, of course, provide a zoom room, if that makes life easier
yes, please :) and thank you! That would be very helpful. I plan to send a reminder email with the video conference information tomorrow morning... I will ping you via Gitter DM for the zoom link/password to use in the reminder email.
Bringing this up again. @ncclementi@jsignell@pavithraes and @jacobtomlinson just organized and built a tutorial for SciPy. I'd like for us to consider delivering this repeatedly online. I'll suggest the following format to get started, but there are probably lots of improvements that could be made.
We aim to deliver this tutorial once a month
Virtually, over Zoom, with Eventbrite signups
But it's too long to deliver in one setting
So we break it up into four one-hour-long sessions delivered once a week ove four weeks
We advertise this and brand it under Dask, rather than any particular company
Totally agree with the general sentiment here. I feel like monthly may be too much. When we did this the first time it felt like numbers dropped quickly after we reached saturation.
Perhaps bi-montly or quarterly would be a better place to start. We could always ramp up if demand is higher.
I like the idea of one hour per week for four weeks though.
Let's do it once at least! 🙂
I'd be in favor of doing it again the following month and see what
happens. I'm unlikely to be the one doing the actual work though, so I'm
happy to be overruled 😉
I think that the two person structure worked well (one person presenting,
another on chat). Does anyone have the bandwidth to organize this?
On Tue, Jul 12, 2022, 9:24 AM Jacob Tomlinson ***@***.***> wrote:
Totally agree with the general sentiment here. I feel like monthly may be
too much. When we did this the first time it felt like numbers dropped
quickly after we reached saturation.
Perhaps bi-montly or quarterly would be a better place to start. We could
always ramp up if demand is higher.
I like the idea of one hour per week for four weeks though.
—
Reply to this email directly, view it on GitHub
<#57 (comment)>, or
unsubscribe
<https://github.com/notifications/unsubscribe-auth/AACKZTBT2FOZZC7B5V3Y7VDVTV52PANCNFSM4NG6DARQ>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
Activity
jacobtomlinson commentedon May 22, 2020
We could try using Twitch and/or YouTube streaming for this, that way they can be archived afterwards and watched back later. Many conferences that have moved online are using these services and it seems to work quite well.
I've been experimenting this week with streaming bits of my open source maintenance work on Twitch and it was pretty easy to get started.
TomAugspurger commentedon May 22, 2020
mrocklin commentedon May 22, 2020
It seems like there are two approaches to video tutorials
I think that they're both useful. It seems like twitch/youtube support more viewers, but don't allow for as much engagement. My guess is that they're better if we're doing new content every time. Video conferencing might be better if we have smaller groups (say 10-20) where the students are going through exercises on their own and being coached by community members. This seems better to me if we do the standard tutorial on a regular basis.
I think that the Dask/NumFOCUS account could be used if we're looking at something in the few hundred dollars range.
jcrist commentedon May 22, 2020
I recently gave the tutorial using the binder setup at tutorial.dask.org, and found it good enough to teach people how dask works and how to think about it. Yes, they didn't get a real "distributed" cluster, but they still got to see how dask's api works and learned how to reason about the various concepts.
jacobtomlinson commentedon May 22, 2020
@mrocklin yeah I agree with that assessment. I think Twitch/YouTube would be good for doing something like a talk. Especially if the recording would be useful afterwards. But then video conference would be good for a more workshop style session.
mrocklin commentedon May 22, 2020
If we have human resources, I'm inclined to try both and see what engages people.
If I were to organize this I would suggest the following:
suckersvolunteers to sign up to deliver these.TomAugspurger commentedon May 22, 2020
jacobtomlinson commentedon May 27, 2020
Happy to be a sucker, although I would like to rotate off Czar duties before that time so that I can spend that time preparing.
mrocklin commentedon May 28, 2020
jacobtomlinson commentedon May 28, 2020
Ok sounds good.
From when you sent that message that would be Friday the 5th of June.
Do you have thoughts on a time? I wonder whether we should try and do it at a time like 2pm, which would be practical for folks in immediately neighbouring timezones. Perhaps trying to alternate the presenter between continents week-to-week to be as inclusive as possible.
martindurant commentedon May 28, 2020
Happy to help out too
mrocklin commentedon May 28, 2020
I think that we'll want at least a weak of lead time to advertise and prep. +1 on switching around time zone availability to support a broad set of attendees.
jacobtomlinson commentedon Jun 4, 2020
Ok given that time is passing I suggest we go for Friday June 12th at 1pm UTC. That'll be 9am east coast US, 2pm for me and 3pm central Europe, so should have good coverage. I also suggest we pencil in 90 minutes for it.
Then maybe next time someone in North America could run it to get coverage for west coast?
I think we should also use Zoom for this first one. Do we have access to a Zoom pro account for avoiding the time limit and doing recordings?
@mrocklin are you able to coordinate promoting it?
mrocklin commentedon Jun 4, 2020
Yes, through NumFOCUS. I've sent you and support@numfocus an e-mail
Definitely. The obvious things to do is tweet it. I can see if there are a couple of other channels.
dgerlanc commentedon Jun 4, 2020
I taught a 4-hour workshop on oreilly.com focused on Dask Dataframes and teaching it again at the end of July. It alternates between lecture/exercise. May be up for doing a volunteer teaching session or integrating these into the docs. Here's a link to the notebooks: https://github.com/dgerlanc/dask-scaling-dataframe.
20 remaining items
cgentemann commentedon Jun 19, 2020
Hi! I attended this morning. Jacob and Matthew - great job!!!! I really appreciated the time and preparation you put into the tutorial.
I think it is interesting to re-imagine what a tutorial is, given that I was still in my PJs and no one knew. My commute was 10'. So, if we all aren't expending the effort to travel to a similar location, then there really isn't any need to meet for an extended period of time. I found Jacob walking us through the tutorials to be really interesting. I wish that it was about 50% slower and I wanted him to spend more time describing Dask and how it was being used, or what functions might be interesting to use here, or his thought process about how he uses these tools for different types of problems and how he troubleshoots/finds solutions.
While tutorials traditionally have show code / do code / repeat structure, I didn't find the coding part as useful during the tutorial. I want to try out the code, but I can do that on my own.
I also really liked reading the chat & response. It worked well to have Jacob focus on the tutorial and Matthew on the chat. I think it would have made it a little more interactive to have Jacob pause every so often & have Matthew answer a chat verbally or have a short conversation with the person who posted. Yes, this will slow things down, but this is why we are all attending -- there are lots of tutorials we can do online or by ourselves, I wanted to hear from Jacob/Matthew how they used Dask and have more of a conversation.
It almost seemed like it would be useful to break up the tutorial into much smaller bits and just do them more frequently.
Again, great job. This was really useful and I hope to see more in the future. I'd love to see how this works on twitch or other platforms.
lesteve commentedon Jun 21, 2020
This looks very nice! For some reason the YouTube video definition is 360p maximum (which makes it hard to read the text of the notebook) but maybe it is just YouTube that takes some time to upload higher resolution videos.
Also I edited the chat log to make it more readable, see https://gist.github.com/lesteve/12042f7df7c3843a9ddde52ccbd0e301 (I never know whether people get notifications from gist comments ...)
mrocklin commentedon Aug 12, 2020
I think that the plan is for @jacobtomlinson to write up the process that we used into a blogpost. Then hopefully @martindurant + someone else will use this plan to run through the process two weeks from now, hopefully at a time that is more convenient for US folks, especially on the west coast.
Additionally on the Pangeo call today I mentioned that it would be fun to repeat this process for other Dask-adjacent projects. I think that Xarray would be a good first candidate for this. @andersy005 said that he felt comfortable volunteering for this.
andersy005 commentedon Aug 12, 2020
👍🏽 I am looking forward to this post, and thank you in advance for putting this together!
martindurant commentedon Sep 15, 2020
@andersy005 the blog post appeared at https://blog.dask.org/2020/08/21/running-tutorials , if you didn't see. If you are interested in running a similar xarray online tutorial, I'd be happy to partner, to help set things up.
andersy005 commentedon Sep 15, 2020
Thank you, @martindurant! What does your schedule look like? I am thinking we could schedule the first session around Friday, Oct 2? @dcherian, would you be interested in join us?
dcherian commentedon Sep 15, 2020
Sure.
martindurant commentedon Sep 15, 2020
Oct 2 is fine with me.
andersy005 commentedon Sep 29, 2020
@jacobtomlinson, do you happen to know the exact root cause for the low quality recording? Do you have any recommendations for addressing this issue?
Also,
I am curious to know how the subsequent tutorials (after the first one) were delivered. Did you use Zoom again? How was the overall experience? Are there any recordings on YouTube? What are your thoughts on Youtube Livestream? I am thinking of using unlisted Youtube Livestream for the upcoming xarray tutorial since I don't have access to a Zoom pro account.
martindurant commentedon Sep 29, 2020
Yes, we used zoom, without any special effects - so the quality was totally fine. I believe the low quality before was to do with the use of OBS. You can screen-share and record the speaker and/or gallery (this with a licensed account). I didn't post the recording, being so similar to the previous tutorial. For some reason, the feedback buttons were missing from the chat on my session, that was the only annoyance, but I'm not sure I would have used them.
(I can, of course, provide a zoom room, if that makes life easier)
andersy005 commentedon Sep 29, 2020
yes, please :) and thank you! That would be very helpful. I plan to send a reminder email with the video conference information tomorrow morning... I will ping you via Gitter DM for the zoom link/password to use in the reminder email.
mrocklin commentedon Jul 12, 2022
Bringing this up again. @ncclementi @jsignell @pavithraes and @jacobtomlinson just organized and built a tutorial for SciPy. I'd like for us to consider delivering this repeatedly online. I'll suggest the following format to get started, but there are probably lots of improvements that could be made.
Thoughts?
jacobtomlinson commentedon Jul 12, 2022
Totally agree with the general sentiment here. I feel like monthly may be too much. When we did this the first time it felt like numbers dropped quickly after we reached saturation.
Perhaps bi-montly or quarterly would be a better place to start. We could always ramp up if demand is higher.
I like the idea of one hour per week for four weeks though.
mrocklin commentedon Jul 12, 2022
martindurant commentedon Jul 12, 2022
@douglasdavis - no pressure, but thought you might find this idea interesting