Training LLM Models with Transformers
Alican Kiraz
Alican Kiraz
ā§Ē.ā§star
ā§§ā§¨ āĻāĻž āĻĒā§°ā§āĻ¯āĻžāĻ˛ā§āĻāĻ¨āĻžreport
āĻāĻŦā§āĻ
90
āĻĒā§āĻˇā§āĻ āĻž
reportāĻŽā§āĻ˛ā§āĻ¯āĻžāĻāĻāĻ¨ āĻā§°ā§ āĻĒā§°ā§āĻ¯āĻžāĻ˛ā§āĻāĻ¨āĻž āĻ¸āĻ¤ā§āĻ¯āĻžāĻĒāĻ¨ āĻā§°āĻž āĻšā§ā§ąāĻž āĻ¨āĻžāĻ  āĻ
āĻ§āĻŋāĻ āĻāĻžāĻ¨āĻ
āĻāĻ āĻāĻŦā§āĻāĻāĻ¨ā§° āĻŦāĻŋāĻˇā§ā§
In our book, we explore in detail the working principles of artificial intelligence, LLM models, how these models can be trained, the training environment, how to prepare training data, and how to write the training code. We will learn in detail how to set up the training environment, use various Transformers libraries, train large LLM models through quantization (LoRA and QLoRA), create datasets in different formats, and grasp the mathematical foundations of artificial intelligence.
āĻŽā§āĻ˛ā§āĻ¯āĻžāĻāĻāĻ¨ āĻā§°ā§ āĻĒā§°ā§āĻ¯āĻžāĻ˛ā§āĻāĻ¨āĻžāĻ¸āĻŽā§āĻš
ā§Ē.ā§
ā§§ā§¨ āĻāĻž āĻĒā§°ā§āĻ¯āĻžāĻ˛ā§āĻāĻ¨āĻž
āĻ˛āĻŋāĻāĻā§° āĻŦāĻŋāĻˇāĻ¯āĻŧā§
Hi, I'm Alican. I have been working in the field of cybersecurity since 2015. In my early years, I developed my skills in Application Security and Bug Hunting. Since 2018, I have been specializing in Blue Team and Purple Team roles. Because I am passionate about cybersecurity, I have participated in numerous training programs and certification courses, and I currently hold 23 different professional certifications. Additionally, I have been involved in various projects in robotics, embedded systems, and artificial intelligence. I support the community on YouTube and Spotify Podcast with more than 50 research and training videos. I also have 2 books and 2 Udemy courses.
āĻāĻ āĻāĻŦā§āĻāĻāĻ¨āĻ āĻŽā§āĻ˛ā§āĻ¯āĻžāĻāĻāĻ¨ āĻā§°āĻ
āĻāĻŽāĻžāĻ āĻāĻĒā§āĻ¨āĻžā§° āĻŽāĻ¤āĻžāĻŽāĻ¤ āĻāĻ¨āĻžāĻāĻāĨ¤
āĻĒāĻĸāĻŧāĻžā§° āĻ¨āĻŋāĻ°ā§āĻĻā§āĻļāĻžā§ąāĻ˛ā§
āĻ¸ā§āĻŽāĻžā§°ā§āĻāĻĢâāĻ¨ āĻā§°ā§ āĻā§āĻŦāĻ˛ā§āĻ
Android āĻā§°ā§ iPad/iPhoneā§° āĻŦāĻžāĻŦā§ Google Play Books āĻāĻĒāĻā§ āĻāĻ¨āĻˇā§āĻāĻ˛ āĻā§°āĻāĨ¤ āĻ āĻ¸ā§āĻŦāĻ¯āĻŧāĻāĻā§āĻ°āĻŋāĻ¯āĻŧāĻāĻžā§ąā§ āĻāĻĒā§āĻ¨āĻžā§° āĻāĻāĻžāĻāĻŖā§āĻā§° āĻ¸ā§āĻ¤ā§ āĻāĻŋāĻāĻ āĻšāĻ¯āĻŧ āĻā§°ā§ āĻāĻĒā§āĻ¨āĻŋ āĻ¯'āĻ¤ā§ āĻ¨āĻžāĻĨāĻžāĻāĻ āĻ¤'āĻ¤ā§āĻ āĻā§āĻ¨ā§ āĻ
āĻĄāĻŋāĻ
'āĻŦā§āĻ āĻ
āĻ¨āĻ˛āĻžāĻāĻ¨ āĻŦāĻž āĻ
āĻĢāĻ˛āĻžāĻāĻ¨āĻ¤ āĻļā§āĻ¨āĻŋāĻŦāĻ˛ā§ āĻ¸ā§āĻŦāĻŋāĻ§āĻž āĻĻāĻŋāĻ¯āĻŧā§āĨ¤
āĻ˛ā§āĻĒāĻāĻĒ āĻā§°ā§ āĻāĻŽā§āĻĒāĻŋāĻāĻāĻžā§°
āĻāĻĒā§āĻ¨āĻŋ āĻāĻŽā§āĻĒāĻŋāĻāĻāĻžā§°ā§° ā§ąā§āĻŦ āĻŦā§āĻ°āĻžāĻāĻāĻžā§° āĻŦā§āĻ¯ā§ąāĻšāĻžā§° āĻā§°āĻŋ Google PlayāĻ¤ āĻāĻŋāĻ¨āĻž āĻ
āĻĄāĻŋāĻ
'āĻŦā§āĻāĻ¸āĻŽā§āĻš āĻļā§āĻ¨āĻŋāĻŦ āĻĒāĻžā§°ā§āĨ¤
āĻ-ā§°ā§āĻĄāĻžā§° āĻā§°ā§ āĻ
āĻ¨ā§āĻ¯ āĻĄāĻŋāĻāĻžāĻāĻ
Kobo eReadersā§° āĻĻā§°ā§ āĻ-āĻāĻŋā§āĻžāĻāĻšā§ā§° āĻĄāĻŋāĻāĻžāĻāĻāĻ¸āĻŽā§āĻšāĻ¤ āĻĒā§āĻŋāĻŦāĻ˛ā§, āĻāĻĒā§āĻ¨āĻŋ āĻāĻāĻž āĻĢāĻžāĻāĻ˛ āĻĄāĻžāĻāĻ¨āĻ˛âāĻĄ āĻā§°āĻŋ āĻ¸ā§āĻāĻā§ āĻāĻĒā§āĻ¨āĻžā§° āĻĄāĻŋāĻāĻžāĻāĻāĻ˛ā§ āĻ¸ā§āĻĨāĻžāĻ¨āĻžāĻ¨ā§āĻ¤ā§°āĻŖ āĻā§°āĻŋāĻŦ āĻ˛āĻžāĻāĻŋāĻŦāĨ¤ āĻ¸āĻŽā§°ā§āĻĨāĻŋāĻ¤ āĻ-ā§°āĻŋāĻĄāĻžā§°āĻ˛ā§ āĻĢāĻžāĻāĻ˛āĻā§ āĻā§āĻ¨ā§āĻā§ āĻ¸ā§āĻĨāĻžāĻ¨āĻžāĻ¨ā§āĻ¤ā§° āĻā§°āĻŋāĻŦ āĻāĻžāĻ¨āĻŋāĻŦāĻ˛ā§ āĻ¸āĻšāĻžāĻ¯āĻŧ āĻā§āĻ¨ā§āĻĻā§ā§°āĻ¤ āĻĨāĻāĻž āĻ¸āĻŦāĻŋāĻļā§āĻˇ āĻ¨āĻŋā§°ā§āĻĻā§āĻļāĻžā§ąāĻ˛ā§ āĻāĻžāĻāĻāĨ¤
