Zoom Logo

W2: 3rd Wordplay: When Language Meets Games Workshop - Shared screen with speaker view
Eric Yuan
01:02:49
Hello everyone
Marc-Alexandre Côté (MSR)
01:04:46
How's the in-person room?
Prithviraj Ammanabrolu
01:05:30
not bad actually, very cozy
Prithviraj Ammanabrolu
01:05:57
Lynn says she'll be on in a min I''ll start with opening remarks
Marc-Alexandre Côté (MSR)
01:06:07
Sounds good.
Eric Yuan
01:06:26
nice tshirt
Marc-Alexandre Côté (MSR)
01:10:44
https://wordplay-workshop.github.io/schedule/
Adam
01:11:50
Nice shirt, Raj!
Lynn
01:13:06
yay raj thanks
Marc-Alexandre Côté (MSR)
01:13:48
Ref: http://www.ghostweather.com/
Chris Callison-Burch
01:14:24
Here's a link for Lynn's newsletter that Raj recommended: https://tinyletter.com/arnicas
Chris Callison-Burch
01:15:11
^Newer link on substack: https://arnicas.substack.com
Chris Callison-Burch
01:30:28
If anyone is interested in trying out Midjourney, the text-to-image program that Lynn mentioned, here's how to join: https://discord.com/invite/midjourney
Eric Yuan
01:32:56
Thanks!
Chris Callison-Burch
02:07:14
Thanks, Lynn!
Eric Yuan
02:07:30
Thank you, Lynn!
Nader Akoury
02:07:35
is there a way to Thanks!
Kory Mathewson
02:07:36
Great talk!
Lara J. Martin
02:07:38
Thank you!
Reza Arabsheibani
02:08:05
well done!
Eric Yuan
02:38:25
audio is from the room mic?
Marc-Alexandre Côté (MSR)
02:38:42
It sounds like it.
Marc-Alexandre Côté (MSR)
02:41:00
Much beter
Eric Yuan
02:41:02
much better now
Marc-Alexandre Côté (MSR)
02:42:10
It was better. Now there's no sound. :D
Sandeep Mathias
02:43:05
Volume is too low!
Eric Yuan
02:45:11
sorry for the technical difficulties!
Marc-Alexandre Côté (MSR)
03:30:17
Follow-up: Is the Wiki accessible from the nle environment?
Eric Yuan
03:31:40
read to fight monsters:
Eric Yuan
03:31:41
https://openreview.net/forum?id=SJgob6NKvH
Minsoo Kim
03:32:14
Thank you for a very interesting talk!In the intrinsic motivation paper, I was curious if the teacher's proposal of goals based strictly on novelty and difficulty of achieving, or if it is connected (or become connected as learning progresses) to what outcome is expected by the proposed goal, thanks!
Chris Callison-Burch
03:33:52
Yes!
Tim Rocktaschel
03:35:12
Yes, the Wiki is accessible from NLE (or MiniHack, not sure if we merged that already into NLE).
Marc-Alexandre Côté (MSR)
03:35:25
Great!
Tim Rocktaschel
03:35:49
See https://github.com/facebookresearch/minihack/blob/main/minihack/wiki.py#L76
Tim Rocktaschel
03:37:59
Minsoo, the goals that the teacher is proposing are disconnected from the extrinsic goal that needs to be achieved in the environment. However, the student receives only a small intrinsic reward when completing the teacher's goal and a larger reward when achieving the extrinsic goal. Thus, once the student has progressed enough and "stumbles" upon the extrinsic goal, it will naturally gravitate towards ignoring the teacher's goals and maximizing return by achieving the extrinsic goal.
Tim Rocktaschel
03:39:12
Ah I guess your question is more about the consequence of achieving an intrinsic goal. No, the teacher isn't explicitly modelling this. Everything is driven by novelty and difficulty.
Marc-Alexandre Côté (MSR)
03:40:08
@Tim you mentionned ton of gameplay recordings, where is that exactly?
Minsoo Kim
03:40:52
Ah I see, it seems a good way to let the agent gravitate towards extrinsic goals, thank you!
Marc-Alexandre Côté (MSR)
03:44:42
Nvm. Got it. https://alt.org/nethack/
Tim Rocktaschel
03:51:53
If you are interested in this, we are releasing the demonstrations from alt.org and have a paper about this: https://openreview.net/forum?id=zHNNSzo10xN
Marc-Alexandre Côté (MSR)
03:57:01
Great! :)
Arianna
04:15:06
Thank you for a really great talk! You didn't need any game to make it a lot of fun :)
Eric Yuan
04:21:55
Lunch Break:
Marc-Alexandre Côté (MSR)
04:22:16
We will be doing a ~1 hour and a quarter lunch break. Make sure you tune in for the two remaining talks.https://wordplay-workshop.github.io/schedule/
Eric Yuan
04:22:23
back at 13:30 PT (16:30 ET)
Marc-Alexandre Côté (MSR)
05:31:35
Hi Shrimai! :)
Shrimai
05:31:43
Hi!
Marc-Alexandre Côté (MSR)
05:32:04
Are you presenting live or with a recording?
Shrimai
05:32:09
Live
Marc-Alexandre Côté (MSR)
05:32:15
Awesome :)
Marc-Alexandre Côté (MSR)
05:32:46
I'll ping Raj and the others (might still be on their lunch break).
Shrimai
05:33:04
No problem. Its not time yet anyway.
Eric Yuan
05:35:56
Welcome back, everyone
Rental
05:35:56
I exist, lets give it a few min ppl still trickling back from lunch
Marc-Alexandre Côté (MSR)
05:36:31
I was afraid you were eaten by a grue.
Eric Yuan
05:38:03
definitely a commonly used excuse by workshop organizers
Rental
05:38:28
I lost Ash somewhere so he might have been, I have no clue where he is
Eric Yuan
05:39:34
wanna introduce your bubble tea?
Rental
05:40:07
taro bubble tea with cheese foam, very high qulity
Shrimai
05:41:09
I click on “unmute" ... but I immediately get muted again
Eric Yuan
05:41:30
maybe rejoin?
Roland Fernandez
05:41:30
That's what it looks like from here, also.
Shrimai
05:41:39
I will try to rejoin
Shrimai
05:42:33
can you unmute me now?
Shrimai
05:43:12
No
Shrimai
05:43:26
I have joined using the zoom link on underline
Shrimai
05:43:31
Should I join using some other link?
Marc-Alexandre Côté (MSR)
05:44:15
Anything weird in your settings?
Eric Yuan
05:44:24
input device or something?
Shrimai
05:44:35
Let me. heck
Marc-Alexandre Côté (MSR)
06:26:24
@Shrimai, loved to see ALFWorld being used. Where is the text (from TextWorld) being used exactly? Is it to get the label from objects and containers?
Shrimai
06:29:00
I believe ALFWorld has a train set for which you can collect expert trajectories in the textual form. We use that textual data for imitation learning.
Marc-Alexandre Côté (MSR)
06:32:53
Ah ok. Looking forward to reading the paper :)
Irina Onoprienko
07:04:39
Question: Have you tested ScienceWorld with actual 5th graders?
Marc-Alexandre Côté (MSR)
07:07:52
In case, we don't get to your question Irina, the short answer is no. We'd love to though :).
Marc-Alexandre Côté (MSR)
07:08:26
Running human study with kids requires a more paperwork :).
Chris Callison-Burch
07:08:40
Here was my question: Thanks for the very cool talk, Peter. This is super-cool work. Have you considered using the models to automatically create simulations, rather than as agents to solve the science puzzles? What kind of challenges would be involved with that?
Marc-Alexandre Côté (MSR)
07:15:08
https://app.gather.town/app/5LQQiHeAhrt5bszR/NAACL2022?spawnToken=cpu47TOFYIGy8KnK
Marc-Alexandre Côté (MSR)
07:15:28
The link can be found in the website too.
Marc-Alexandre Côté (MSR)
07:15:32
https://wordplay-workshop.github.io/schedule/