www.loom.com Open in urlscan Pro
2600:9000:275b:8400:c:cfd4:a580:93a1  Public Scan

URL: https://www.loom.com/share/d5ad711d586b43b88445c9c6ec6c3904
Submission: On October 03 via manual from TR — Scanned from DE

Form analysis 0 forms found in the DOM

Text Content

Loom



Login
RLHF Code Review


Gabe Greenberg・
5 months ago
10617 views

0.8×
1×
1.2×
1.5×
1.7×
2×
2.5×
6 min⚡️7 min 54 sec6 min 19 sec5 min 16 sec4 min 13 sec3 min 43 sec3 min 9 sec2
min 31 sec
🙌
Anonymous
👍
Walid Ebaid
😮
Anonymous
😮
Anonymous
👍
Anonymous
👍
Walid Ebaid
👍
Walid Ebaid
👍
Walid Ebaid
👍
lavanya shirur sudhakar
👍
Walid Ebaid
👍
Walid Ebaid
👍
Walid Ebaid
👍
Walid Ebaid
👍
Walid Ebaid
👍
Walid Ebaid
😍
Anonymous
👍
abdessamad ennaciri
👍
Anonymous
🚀
Anonymous
😮
Anonymous
😮
Anonymous
😍
Cristhan Dave Espiritu
👍
abdessamad ennaciri
👍
Anonymous
👍
Anonymous
👍
Anonymous
👍
Walid Ebaid
😮
Anonymous
💯
Anonymous
👍
Elizabeth Oviedo
😮
Anonymous
😮
Anonymous
👍
Elizabeth Oviedo
👍
Anonymous
🙌
Anonymous
👍
Anonymous
🙌
Anonymous
👍
Rajbeer Singh
👍
Rajbeer Singh
👍
Rajbeer Singh
👍
Rajbeer Singh
👍
Rajbeer Singh
👍
Anonymous
👍
Anonymous
🙌
Anonymous
😍
Shafeen Ahmed
😍
Shafeen Ahmed
😍
Shafeen Ahmed
👍
Anonymous
👍
Anonymous


0.8×
1×
1.2×
1.5×
1.7×
2×
2.5×
6 min⚡️7 min 54 sec6 min 19 sec5 min 16 sec4 min 13 sec3 min 43 sec3 min 9 sec2
min 31 sec
🙌
Anonymous
👍
Walid Ebaid
😮
Anonymous
😮
Anonymous
👍
Anonymous
👍
Walid Ebaid
👍
Walid Ebaid
👍
Walid Ebaid
👍
lavanya shirur sudhakar
👍
Walid Ebaid
👍
Walid Ebaid
👍
Walid Ebaid
👍
Walid Ebaid
👍
Walid Ebaid
👍
Walid Ebaid
😍
Anonymous
👍
abdessamad ennaciri
👍
Anonymous
🚀
Anonymous
😮
Anonymous
😮
Anonymous
😍
Cristhan Dave Espiritu
👍
abdessamad ennaciri
👍
Anonymous
👍
Anonymous
👍
Anonymous
👍
Walid Ebaid
😮
Anonymous
💯
Anonymous
👍
Elizabeth Oviedo
😮
Anonymous
😮
Anonymous
👍
Elizabeth Oviedo
👍
Anonymous
🙌
Anonymous
👍
Anonymous
🙌
Anonymous
👍
Rajbeer Singh
👍
Rajbeer Singh
👍
Rajbeer Singh
👍
Rajbeer Singh
👍
Rajbeer Singh
👍
Anonymous
👍
Anonymous
🙌
Anonymous
😍
Shafeen Ahmed
😍
Shafeen Ahmed
😍
Shafeen Ahmed
👍
Anonymous
👍
Anonymous


Your user agent does not support the HTML5 Video element.

😂
joy
1
😍
love
2
😮
wow
3
🙌
yay
4
👍
up
5
👎
down
6
More reactions
7

Record a Loom

Activity
Transcript

Comments disabled
The creator of this video has turned off comments.
Search
Copy
0:00

So the code review, we used to do live testing, and it was a different format,
it wasn't a code review, and we moved away from it because we didn't think it
was one-to-one to the work that you'd be doing.
0:15

We believe that this code review was designed really to mimic the, reinforcement
learning through human feedback work that you'd be doing if you get this role at
Outlier.
0:26

You know, it's not incredibly difficult. It's really on the easier side
technically because we're looking to assess your written communication skills,
your attention to detail, the other pieces that we can do better async in our
opinion.
0:40

So, So, you'll be getting this email once we review your application, you know,
we forward this over to you. And, you know, it doesn't start until, you know,
you can click this and it won't start.
0:59

Like you can, review the beginning piece. It's not going to start. And, you can
use the language of your choice as well.
1:09

We have, you know, five languages right now. TypeScript, JavaScript, Python,
Java, and C-sharp. If you're, use whatever you're most comfortable with.
1:19

But if you're like have a toss-up, Python would be my suggestion. Just because
we see a lot of Python in outlier, you know, projects.
1:29

But it's not going to necessarily, you know, help you dramatically or anything.
In terms of, you know, the invite, the invite will expire.
1:41

The test itself will expire 72 hours after we send it. And we're going to really
stick to that the best we can.
1:49

Because our timeline is tight, you know, we're filling these roles. So, we will
make indicate, if you have an emergency, something happens, no worries, we'll
give you an extension.
2:00

You can click the dashboard, and I'll show you how to do that. So, if you click
go to code review details, you come here, and there's no time at this point.
2:14

You can watch Lee explain it, you'd have to click the terms of service here.
Don't watch this, this is a little bit misleading.
2:26

We don't use this IDE, I don't think. So yeah, you can read through the
instructions, or you can decide you're going to do it in a little bit.
2:36

I think the best time to do it is now. Don't delay, commit to a time that you're
going to do it, and then execute.
2:45

That's my encouragement to you. And then at the end, so you go through the code
review, and at the end we ask you for a 5 minute or less video, and it's all
done here.
3:00

Sometimes, you know, it won't work, because you might have multiple devices
plugged in, various reasons. So there's a couple ways, you know, around that.
3:11

One, you know, if you're using Chrome, you can click on, you know, this, and go
to manage, and you can put it back to the right thing.
3:22

However, when you come back to here, it will still be broken, you'll have to
refresh, and you can refresh as many times as you want, and it's not going to
kick you out.
3:33

So, that's the trick, because it happened to me the first time. Once you start
recording and stop, You can do a quick test, start and stop, like for 5 seconds
if you want, and then you can see if it comes out.
3:47

You can go be ahead of the game and get the M, I think it's, What is it? The VLC
player would be the MKV5.
4:01

Yeah, VLC media player is what you can use. Alternatively, you can just go to
loom.com and have it ready just as a backup for this not working.
4:15

And then you can copy and paste that link into earlier in the process. Just, you
know, say, hey, the video didn't work.
4:23

Here you go. At least we have it. No issues there. Uhm, and then it'll count
down if you leave it to the end.
4:32

Just a heads up, it gets really loud in the last like 30 seconds. Uhm, kind of
annoying. Uh, and then, If you let it go all the way down, it'll move to this
page.
4:44

So, just wanted to make you feel comfortable. You see this process. I'm not
going to let you see the challenge itself.
4:49

Cause, you know, I want you to take your time and read the documentation. Uhm,
you know, in that half hour window, some people takes less.
4:59

Uh, and, And, if you have issues, uhm, for whatever reason, that's why we built
this dashboard, uhm, you know, you go through here, especially if, uhm, you
know, maybe you've already clicked through some of these steps, which is fine,
you can go back and forth, uhm, and, uh, know, if you had an emergency
5:23

, you need an extension, uhm, you need us to reissue it, click here, we'll get
it on our back end. We have somebody looking at this, uhm, every single day,
emailing us isn't the best way.
5:33

Uhm, if you, for some reason, didn't upload your video then, or had other
issues, and just couldn't get it done, or, like, you were in a noisy cafe or
something like that, I mean, you can upload it here, uhm, and we will get it,
you click that, and, ideally, just do a loom, copy and paste, as soon as
5:53

you copy and paste it in there, we'll have it in our back end. Uhm, and if
you're, you know, going through this, uhm, uh, dashboard, and you haven't
completed this step, you know, and, uh, but you're planning on it, it'd be great
to give us, you know, that information, or if you're not planning on moving




Dragto resize
Clickto collapse
T