RL 2023 - История изменений

Ivlevin в 16:19, 25 ноября 2023

2023-11-25T16:19:35Z

← Предыдущая версия		Версия от 16:19, 25 ноября 2023
Строка 15:		Строка 15:
	The final grade consists of 2 components (each is non-negative real number from 0 to 10, without any intermediate rounding) :		The final grade consists of 2 components (each is non-negative real number from 0 to 10, without any intermediate rounding) :
	* O<sub>HW</sub> for the hometasks		* O<sub>HW</sub> for the hometasks
	* O<sub>~~Project~~</sub> for the ~~course project~~		* O<sub>Exam</sub> for the exam
	The formula for the final grade is		The formula for the final grade is
	* O<sub>Final</sub> = 0.6O<sub>HW</sub> + 0.4O<sub>~~Project~~</sub>		* O<sub>Final</sub> = 0.6O<sub>HW</sub> + 0.4O<sub>Exam</sub>
	with the usual (arithmetical) rounding rule.		with the usual (arithmetical) rounding rule.

Ivlevin в 12:10, 24 ноября 2023

2023-11-24T12:10:42Z

← Предыдущая версия		Версия от 12:10, 24 ноября 2023
Строка 23:		Строка 23:
	*[https://www.overleaf.com/read/kbzmvxdzbrxq '''Lectures and seminars notes''']		*[https://www.overleaf.com/read/kbzmvxdzbrxq '''Lectures and seminars notes''']
	*[https://colab.research.google.com/drive/10qBq7Ot_1ZpnTeD11P5AnE8jFVj0OLXl?usp=sharing '''Notebook for the first seminar''']		*[https://colab.research.google.com/drive/10qBq7Ot_1ZpnTeD11P5AnE8jFVj0OLXl?usp=sharing '''Notebook for the first seminar''']

			== Homeworks ==
			*[https://disk.yandex.ru/i/C8hwvvS5us09sA '''HW 1''']


	== Recommended literature ==		== Recommended literature ==

Ivlevin в 09:36, 13 ноября 2023

2023-11-13T09:36:17Z

← Предыдущая версия		Версия от 09:36, 13 ноября 2023
Строка 10:		Строка 10:

	== About the course ==		== About the course ==
	This page contains materials for Mathematical Foundations of Reinforcement learning course in ~~2022/~~2023 year, optional one for 2nd year Master students of the Math of Machine Learning program (HSE and Skoltech).		This page contains materials for Mathematical Foundations of Reinforcement learning course in 2023 year, optional one for 2nd year Master students of the Math of Machine Learning program (HSE and Skoltech).

	== Grading ==		== Grading ==

Ivlevin в 09:35, 13 ноября 2023

2023-11-13T09:35:49Z

← Предыдущая версия		Версия от 09:35, 13 ноября 2023
Строка 5:		Строка 5:
	\|\| Lecturer \|\| [https://www.hse.ru/staff/anaumov Alexey Naumov] \|\| [anaumov@hse.ru] \|\| T924		\|\| Lecturer \|\| [https://www.hse.ru/staff/anaumov Alexey Naumov] \|\| [anaumov@hse.ru] \|\| T924
	\|-		\|-
	\|\| Seminarist \|\| [Ilya Levin] \|\| [tg: @levensons] \|\| T926		\|\| Seminarist \|\| Ilya Levin \|\| [tg: @levensons] \|\| T926
	\|-		\|-
	\|}		\|}

Ivlevin в 09:35, 13 ноября 2023

2023-11-13T09:35:28Z

← Предыдущая версия		Версия от 09:35, 13 ноября 2023
Строка 5:		Строка 5:
	\|\| Lecturer \|\| [https://www.hse.ru/staff/anaumov Alexey Naumov] \|\| [anaumov@hse.ru] \|\| T924		\|\| Lecturer \|\| [https://www.hse.ru/staff/anaumov Alexey Naumov] \|\| [anaumov@hse.ru] \|\| T924
	\|-		\|-
	\|\| Seminarist \|\| [~~https://www.hse.ru/org/persons/219484540 Sergey Samsonov~~] \|\| [~~svsamsonov~~@~~hse.ru~~] \|\| T926		\|\| Seminarist \|\| [Ilya Levin] \|\| [tg: @levensons] \|\| T926
	\|-		\|-
	\|}		\|}

Ivlevin в 09:34, 13 ноября 2023

2023-11-13T09:34:49Z

← Предыдущая версия		Версия от 09:34, 13 ноября 2023
Строка 19:		Строка 19:
	* O<sub>Final</sub> = 0.6O<sub>HW</sub> + 0.4O<sub>Project</sub>		* O<sub>Final</sub> = 0.6O<sub>HW</sub> + 0.4O<sub>Project</sub>
	with the usual (arithmetical) rounding rule.		with the usual (arithmetical) rounding rule.

	~~[https://docs.google.com/spreadsheets/d/1MPWVIkgxyotHU-P5cE7Gik4C6RTWxTnAVK8Btl7Fw3Y/edit?usp=sharing '''Table with grades''']~~

	== Course materials ==		== Course materials ==

Ivlevin в 09:34, 13 ноября 2023

2023-11-13T09:34:08Z

← Предыдущая версия		Версия от 09:34, 13 ноября 2023
Строка 34:		Строка 34:

	==Homeworks ==		==Homeworks ==
	*[https://github.com/svsamsonov/Math_RL_2022_2023 '''HW #1, deadline: 04.12.22, 23:59''']

	== Projects ==		== Projects ==

Ivlevin: Новая страница: «== Lecturers and Seminarists == {| class="wikitable" style="text-align:center" |- || Lecturer || [https://www.hse.ru/staff/anaumov Alexey Naumov] || [anaumov@hse…»

2023-11-13T09:33:01Z

Новая страница: «== Lecturers and Seminarists == {| class="wikitable" style="text-align:center" |- || Lecturer || [https://www.hse.ru/staff/anaumov Alexey Naumov] || [anaumov@hse…»

Новая страница

== Lecturers and Seminarists ==

{| class="wikitable" style="text-align:center"
|-
|| Lecturer || [https://www.hse.ru/staff/anaumov Alexey Naumov] || [anaumov@hse.ru] || T924
|-
|| Seminarist || [https://www.hse.ru/org/persons/219484540 Sergey Samsonov] || [svsamsonov@hse.ru] || T926
|-
|}

== About the course ==
This page contains materials for Mathematical Foundations of Reinforcement learning course in 2022/2023 year, optional one for 2nd year Master students of the Math of Machine Learning program (HSE and Skoltech).

== Grading ==
The final grade consists of 2 components (each is non-negative real number from 0 to 10, without any intermediate rounding) :
* OHW for the hometasks
* OProject for the course project
The formula for the final grade is
* OFinal = 0.6*OHW + 0.4*OProject
with the usual (arithmetical) rounding rule.

[https://docs.google.com/spreadsheets/d/1MPWVIkgxyotHU-P5cE7Gik4C6RTWxTnAVK8Btl7Fw3Y/edit?usp=sharing '''Table with grades''']

== Course materials ==
*[https://www.overleaf.com/read/kbzmvxdzbrxq '''Lectures and seminars notes''']
*[https://colab.research.google.com/drive/10qBq7Ot_1ZpnTeD11P5AnE8jFVj0OLXl?usp=sharing '''Notebook for the first seminar''']

== Recommended literature ==

* Sebastien Bubek, Nicolo Cesa-Bianchi. Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems. Chapter 2. http://sbubeck.com/SurveyBCB12.pdf
* Richard S. Sutton, Andrew G. Barto. Reinforcement Learning: An Introduction. Chapter 2. http://incompleteideas.net/book/the-book-2nd.html;
* Botao Hao et al. Bootstrapping Upper Confidence Bound. https://arxiv.org/abs/1906.05247
* Aleksandrs Slivkins. Introduction to Multi-Armed Bandits. https://arxiv.org/abs/1904.07272 [Chapter 1]

==Homeworks ==
*[https://github.com/svsamsonov/Math_RL_2022_2023 '''HW #1, deadline: 04.12.22, 23:59''']

== Projects ==