22. Gradient Descent: Downhill to a Minimum

Share this & earn $10
MIT OpenCourseWare
Published at : 15 Jan 2021
24674 views
401
3

MIT 18.065 Matrix Methods in Data Analysis, Signal Processing, and Machine Learning, Spring 2018
Instructor: Gilbert Strang
View the complete course: https://ocw.mit.edu/18-065S18
YouTube Playlist: https://www.youtube.com/playlist?list=PLUl4u3cNGP63oMNUHXqIUcrkS2PivhN3k

Gradient descent is the most common optimization algorithm in deep learning and machine learning. It only takes into account the first derivative when performing updates on parameters - the stepwise process that moves downhill to reach a local minimum.

License: Creative Commons BY-NC-SA
More information at https://ocw.mit.edu/terms
More courses at https://ocw.mit.edu
gradient descentHessian matrixconvexity

A VERY LARGE EXPANSE OF SEA by Tahereh Mafi | non-spoiler review + booktalk

A VERY LARGE EXPANSE OF SEA by Tahereh Mafi | non-spoiler review + booktalk

Video showing purported Pakistan army attack on Taliban

Video showing purported Pakistan army attack on Taliban

Is There a Finite Number of Souls?

Is There a Finite Number of Souls?

Old Enough - The Raconteurs (lyrics)

Old Enough - The Raconteurs (lyrics)

Daley - U Don't Have To Call / Diamonds & Pearls / Untitled / Get Lonely

Daley - U Don't Have To Call / Diamonds & Pearls / Untitled / Get Lonely

EVERGLOW (에버글로우) - LA DI DA MV

EVERGLOW (에버글로우) - LA DI DA MV

Heroclix Unboxing: House of X Case (2 Bricks!), Fast Forces, and Play at Home Kit

Heroclix Unboxing: House of X Case (2 Bricks!), Fast Forces, and Play at Home Kit

Eli Lilly CEO Says Virus Will Be 'Endemic'

Eli Lilly CEO Says Virus Will Be 'Endemic'

Dua Before Going into the Bathroom Toilet - Lavatory- Protection against Jinn

Dua Before Going into the Bathroom Toilet - Lavatory- Protection against Jinn

Lyn Lapid - Producer Man (Lyric Video)

Lyn Lapid - Producer Man (Lyric Video)

There's Someone Else Here! | Observation - Part 2

There's Someone Else Here! | Observation - Part 2

Security and defence: Has the time come for an EU army?

Security and defence: Has the time come for an EU army?

Why Trains Has X Symbol And Red Lamp  -  Urdu Information about Trains

Why Trains Has X Symbol And Red Lamp - Urdu Information about Trains

Widex Evoke Hearing Aid Review | First Hearing Aid with Machine Learning

Widex Evoke Hearing Aid Review | First Hearing Aid with Machine Learning

Within Reason - Here Comes The Light

Within Reason - Here Comes The Light

Sebi panel proposes new norms to prohibit insider trading

Sebi panel proposes new norms to prohibit insider trading

TIBAY | CE group | Thermal Walls | Video Presentation: ENG13 - A4

TIBAY | CE group | Thermal Walls | Video Presentation: ENG13 - A4

HOW THE FACTIONS ARE PREPARING FOR VANITY XMAS MAP (TURBO OP COMP MAP!)

HOW THE FACTIONS ARE PREPARING FOR VANITY XMAS MAP (TURBO OP COMP MAP!)

Command & Conquer Evolution And History | 1995 - 2021 | [PC ONLY]

Command & Conquer Evolution And History | 1995 - 2021 | [PC ONLY]

BLACKPINK Lisa 'SENORITA' Dance Mirrored

BLACKPINK Lisa 'SENORITA' Dance Mirrored

ABRAHAM HICKS 2020 How To APPROACH LIFE NEW 2020

ABRAHAM HICKS 2020 How To APPROACH LIFE NEW 2020

Persistently PRAY- Rachel Zaferatos

Persistently PRAY- Rachel Zaferatos

Esma and Asya garden hide and seek for kids video

Esma and Asya garden hide and seek for kids video

WORK WEEK IN MY LIFE: ITALY WORK TRIP!

WORK WEEK IN MY LIFE: ITALY WORK TRIP!

Ryo Swimsuit Costume Story (Translated)

Ryo Swimsuit Costume Story (Translated)

How To Tailor A T-Shirt

How To Tailor A T-Shirt

NEW SKIN is INCREDIBLE in Stick War Legacy!! - Stick War Legacy Missions

NEW SKIN is INCREDIBLE in Stick War Legacy!! - Stick War Legacy Missions

THE FIRST Official Trailer (2018) Sean Penn, TV Series HD

THE FIRST Official Trailer (2018) Sean Penn, TV Series HD

THIS WAS THE BEST GOLF LESSON IVE EVER HAD

THIS WAS THE BEST GOLF LESSON IVE EVER HAD

Clams Casino - i'm god (arael redo) (Music Video)

Clams Casino - i'm god (arael redo) (Music Video)

Vivo | Connections Should Have No Limits

Vivo | Connections Should Have No Limits

Do You Have a Derivative Right to Reside in the UK?

Do You Have a Derivative Right to Reside in the UK?

bts moments that have comedians jobless

bts moments that have comedians jobless

(EPIC FAIL) They Went INSANE Really Quick "GET OUT NOW!!!"

(EPIC FAIL) They Went INSANE Really Quick "GET OUT NOW!!!"

Jahmiel - Years To Come (Lyrics CC)

Jahmiel - Years To Come (Lyrics CC)

Granny vs Siren Head vs Piggy  - funny horror animation parody (all series about Siren Head)

Granny vs Siren Head vs Piggy - funny horror animation parody (all series about Siren Head)

A Model of Sophistication |  1677 N Doheny Dr, Sunset Strip

A Model of Sophistication | 1677 N Doheny Dr, Sunset Strip

05 - “Three Angels’ Messages: Fear God and give Him Glory” - David Shin

05 - “Three Angels’ Messages: Fear God and give Him Glory” - David Shin

MOLPEDIA @ TOOLS - original entertainment game show #S1E2

MOLPEDIA @ TOOLS - original entertainment game show #S1E2

News Words: Lucrative

News Words: Lucrative

Watercolor for Beginners | How to Use Wet-on-Dry (Part 2)

Watercolor for Beginners | How to Use Wet-on-Dry (Part 2)

playing jailbreak yet again with anthony

playing jailbreak yet again with anthony

How To Analyze Songs

How To Analyze Songs

Linking words of contrast

Linking words of contrast

DO YOU WANT THE HIGHEST LEVEL OF JANNAH?

DO YOU WANT THE HIGHEST LEVEL OF JANNAH?

Best Indicators To Use For Day Trading Stocks | TOP 4

Best Indicators To Use For Day Trading Stocks | TOP 4

A Competent Handmaiden Chapter 48 English

A Competent Handmaiden Chapter 48 English

FNaF 1 reacts to “They’ll Find You” +Chris and Michael     (Read DESC pls)

FNaF 1 reacts to “They’ll Find You” +Chris and Michael (Read DESC pls)

NCT DREAM (엔시티드림) - Quiet Down (Easy Lyrics)

NCT DREAM (엔시티드림) - Quiet Down (Easy Lyrics)