www.youtube.com Open in urlscan Pro
2607:f8b0:4004:c07::88  Public Scan

Form analysis
1 forms found in the DOM

/results

<form id="search-form" action="/results" class="style-scope ytd-searchbox">
  <div id="container" class="style-scope ytd-searchbox">
    <yt-icon id="search-icon" class="style-scope ytd-searchbox"><!--css-build:shady--><!--css-build:shady--><yt-icon-shape class="style-scope yt-icon"><icon-shape class="yt-spec-icon-shape">
          <div style="width: 100%; height: 100%; fill: currentcolor;"><svg xmlns="http://www.w3.org/2000/svg" enable-background="new 0 0 24 24" height="24" viewBox="0 0 24 24" width="24" focusable="false"
              style="pointer-events: none; display: block; width: 100%; height: 100%;">
              <path d="m20.87 20.17-5.59-5.59C16.35 13.35 17 11.75 17 10c0-3.87-3.13-7-7-7s-7 3.13-7 7 3.13 7 7 7c1.75 0 3.35-.65 4.58-1.71l5.59 5.59.7-.71zM10 16c-3.31 0-6-2.69-6-6s2.69-6 6-6 6 2.69 6 6-2.69 6-6 6z"></path>
            </svg></div>
        </icon-shape></yt-icon-shape></yt-icon>
    <div id="search-input" class="ytd-searchbox-spt" slot="search-input"><input id="search" autocapitalize="none" autocomplete="off" autocorrect="off" name="search_query" tabindex="0" type="text" spellcheck="false" placeholder="Search"
        aria-label="Search"></div>
    <div id="search-clear-button" class="style-scope ytd-searchbox" hidden=""><ytd-button-renderer class="style-scope ytd-searchbox" button-renderer="" button-next=""><!--css-build:shady--><yt-button-shape><button
            class="yt-spec-button-shape-next yt-spec-button-shape-next--text yt-spec-button-shape-next--mono yt-spec-button-shape-next--size-m yt-spec-button-shape-next--icon-only-default" aria-label="Clear search query" title="" style="">
            <div class="yt-spec-button-shape-next__icon" aria-hidden="true"><yt-icon style="width: 24px; height: 24px;"><!--css-build:shady--><!--css-build:shady--><yt-icon-shape class="style-scope yt-icon"><icon-shape class="yt-spec-icon-shape">
                    <div style="width: 100%; height: 100%; fill: currentcolor;"><svg xmlns="http://www.w3.org/2000/svg" enable-background="new 0 0 24 24" height="24" viewBox="0 0 24 24" width="24" focusable="false"
                        style="pointer-events: none; display: block; width: 100%; height: 100%;">
                        <path d="m12.71 12 8.15 8.15-.71.71L12 12.71l-8.15 8.15-.71-.71L11.29 12 3.15 3.85l.71-.71L12 11.29l8.15-8.15.71.71L12.71 12z"></path>
                      </svg></div>
                  </icon-shape></yt-icon-shape></yt-icon></div><yt-touch-feedback-shape style="border-radius: inherit;">
              <div class="yt-spec-touch-feedback-shape yt-spec-touch-feedback-shape--touch-response" aria-hidden="true">
                <div class="yt-spec-touch-feedback-shape__stroke" style=""></div>
                <div class="yt-spec-touch-feedback-shape__fill" style=""></div>
              </div>
            </yt-touch-feedback-shape>
          </button></yt-button-shape><tp-yt-paper-tooltip fit-to-visible-bounds="" offset="8" disable-upgrade=""></tp-yt-paper-tooltip></ytd-button-renderer></div>
  </div>
  <div id="search-container" class="ytd-searchbox-spt" slot="search-container"></div>
</form>

Text Content

•


NaN / NaN













Back





Skip navigation

Search
Search


Search with your voice
Sign in







Flash Attention in less than 5 lines of code 🧑‍💻

Search

Watch later

Share

Copy link

Info

Shopping


Tap to unmute


2x


If playback doesn't begin shortly, try restarting your device.










•


Up next

Live
Upcoming


CancelPlay Now


You're signed out
Videos you watch may be added to the TV's watch history and influence TV
recommendations. To avoid this, cancel and sign in to YouTube on your computer.
CancelConfirm

Share
Include playlist


An error occurred while retrieving sharing information. Please try again later.



0:00






0:00 / 1:21•Watch full videoLive
•


•


Scroll for details




FLASH ATTENTION IN LESS THAN 5 LINES OF CODE 🧑‍💻

Kye Gomez
Kye Gomez
85 subscribers



<__slot-el>
Subscribe



<__slot-el>
Subscribed



2




Share

Share
Download

Download

Save








71 views 9 days ago
71 views • Premiered Dec 17, 2023

Show less
DEMO LINK: https://github.com/kyegomez/zeta ZETA FRAMEWORK:
https://github.com/kyegomez/zeta  …...more
...more


KYE GOMEZ

85 subscribers
Videos

About



Show less








FLASH ATTENTION IN LESS THAN 5 LINES OF CODE 🧑‍💻

71 views71 views
Premiered Dec 17, 2023

2




Share

Share
Download

Download

Save














0 COMMENTS

Sort comments
Sort by
Top comments

Newest first






Add a comment...












DESCRIPTION






Flash Attention in less than 5 lines of code 🧑‍💻
Kye Gomez
Kye Gomez

DEMO LINK: https://github.com/kyegomez/zeta ZETA FRAMEWORK:
https://github.com/kyegomez/zeta Learn how to leverage flash attention in just 5
lines of code using Zeta! With Zeta's high-performance and scalable building
blocks, you can build SOTA AI models 80% faster. Install Zeta with: $pip install
zetascale and start your journey towards creating breakthrough AI models. Simply
import torch and FlashAttention from zeta.nn.attention, define your input
tensors q, k, and v, initialize and apply the FlashAttention module, and see the
output shape with print(output.shape). It's that easy!
Show less Show more


KYE GOMEZ

85 subscribers
Videos

About






COMMENTS




Top comments

Newest first






NaN / NaN








Chat Replay is disabled for this Premiere.



2:00:17
Now playing




ACTIVE LISTENING - KOSA, CLOUDFLARE'S NUMBERS, SPINRITE UPDATE

Security Now
Security Now
•
•
9.1K views 7 days ago







3:56:48
Now playing




🔴 LET’S BUILD DISNEY+ 2.0 WITH NEXT.JS 14! (MICROSOFT AZURE, CACHING, OPENAI,
SHADCN, TAILWIND, TS)

Sonny Sangha
Sonny Sangha

Verified
•
•
36K views Streamed 8 days ago







2:44:07
Now playing




BUILD THE IOS VOICE MEMOS APP IN REACT NATIVE | DEVEMBER DAY 7

notJust․dev
notJust․dev
•
•
11K views Streamed 2 weeks ago


Fundraiser







18:32
Now playing




THE BILLION DOLLAR RACE FOR THE PERFECT DISPLAY

TechAltar
TechAltar

Verified
•
•
974K views 2 weeks ago







1:25:23
Now playing




CELA WORKSHOP: INTRO TO AI

Central Eurasia Leadership Alliance
Central Eurasia Leadership Alliance
•
•
1.4K views 7 days ago







14:56
Now playing




THIS SINGLE BOARD COMPUTER IS FASTER THAN A MAC MINI AND A RASPBERRY PI

ServeTheHome
ServeTheHome
•
•
391K views 5 months ago







39:19
Now playing




THE ULTIMATE BROWSER TIER LIST (BASED TIER TO SPYWARE TIER)

Eric Murphy
Eric Murphy
•
•
1.6M views 9 months ago







3:00:42
Now playing




GETTING STARTED WITH REACT NATIVE AND EXPO | DEVEMBER DAY 1

notJust․dev
notJust․dev
•
•
13K views Streamed 3 weeks ago


Fundraiser







6:29
Now playing




HOW AMAZON’S CUSTOM AI CHIPS WORK | WSJ TECH BEHIND

The Wall Street Journal
The Wall Street Journal

Verified
•
•
28K views 6 hours ago


New







12:08
Now playing




WHICH IS THE BEST DNS FOR SECURE BROWSING: CLOUDFLARE, QUAD9, NEXTDNS, AND
ADGUARD DNS

Lawrence Systems
Lawrence Systems

Verified
•
•
42K views 2 months ago







34:52
Now playing




OPENAI ASSISTANTS API TO BUILD AI AGENT SWARMS. BETTER THAN AUTOGEN?

Wes Roth
Wes Roth
•
•
39K views 1 month ago







23:40
Now playing




HOW GAMES HAVE WORKED FOR 30 YEARS TO DO LESS WORK

SimonDev
SimonDev
•
•
836K views 3 weeks ago







44:07
Now playing




THE COMPLETE IDIOT'S GUIDE TO WINDOWS 11 | HOW TO DO EVERYTHING

Ask Your Computer Guy
Ask Your Computer Guy
•
•
16K views 1 month ago







16:39
Now playing




IT'S BETTER - THE BEST MINI PC TODAY

ServeTheHome
ServeTheHome
•
•
362K views 4 months ago







9:43
Now playing




I HACKED MY INTERNET SERVICE PROVIDER'S ROUTER. SO I COULD GET RID OF IT.

Tomaž Zaman
Tomaž Zaman
•
•
479K views 8 days ago







1:16:57
Now playing




GEN AI: DECODING THE NEW SHINY THING!

ISC2 Colombo Chapter, Sri Lanka
ISC2 Colombo Chapter, Sri Lanka
•
•
401 views 3 days ago


New







15:59
Now playing




ARE YOU STILL USING MICROSOFT OFFICE? TIME TO MOVE ON. AN ALTERNATIVE.

Rob Braxman Tech
Rob Braxman Tech
•
•
288K views 1 month ago







12:09
Now playing




WHY DO SO MANY YOUTUBERS RUN ARCH RATHER THAN MINT?

DistroTube
DistroTube

Verified
•
•
62K views 3 months ago







17:26
Now playing




QUICK TIPS TO IMPROVE LINUX SECURITY ON YOUR DESKTOP, LAPTOP, OR SERVER
(HARDENING FOR BEGINNERS)

The Linux Experiment
The Linux Experiment

Verified
•
•
144K views 2 months ago







17:33
Now playing




ARCHIVAL GRADE FLATBED BOOK SCANNER - AVISION FB6080E

Tech Tangents
Tech Tangents
•
•
45K views 11 days ago









Show more



Experiencing interruptions?
Find out why