{
  "id": 444825,
  "title": "Video available: Pyboost - from creator - Anton Vakrushev - Monday 17.00 (CET) 11 December. Webinars related to the competition ",
  "url": "/competitions/open-problems-single-cell-perturbations/discussion/444825",
  "author_name": "",
  "post_date": "2023-10-03T19:18:12.108760300Z",
  "votes": 22,
  "comment_count": 19,
  "views": 0,
  "content": "<p>📹 Video: <a href=\"https://youtu.be/5xRxuDh_cGk\" target=\"_blank\">https://youtu.be/5xRxuDh_cGk</a><br>\n📖 Presentation: <a href=\"https://t.me/sberlogacompete/10211\" target=\"_blank\">https://t.me/sberlogacompete/10211</a></p>\n<p>Pyboost has been used by many during the competition. Happy to invite everybody to a webinar where its creator Anton Vakhrushev will explain more on it: </p>\n<p>👨‍🔬 Anton Vakhrushev \"SketchBoost: Fast Gradient Boosted Decision Tree for Multioutput Problems\"<br>\n⌚️ Monday 11 December 17.00 (CET time)</p>\n<p><a href=\"https://calendar.google.com/calendar/render?action=TEMPLATE&amp;dates=20231211T160000Z%2F20231211T173000Z&amp;details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&amp;text=Anton%20Vakhrushev%20%22SketchBoost%3A%20Fast%20Gradient%20Boosted%20Decision%20Tree%20for%20Multioutput%20Problems%22\" target=\"_blank\">Add to Google Calendar</a></p>\n<p>Twitter: <a href=\"https://x.com/sberloga/status/1733589792024080479?s=20\" target=\"_blank\">https://x.com/sberloga/status/1733589792024080479?s=20</a><br>\nWould be happy for retwit </p>\n<p>Gradient Boosted Decision Tree (GBDT) is a widely-used machine learning algorithm that has been shown to achieve state-of-the-art results on many standard data science problems. We are interested in its application to multioutput problems when the output is highly multidimensional. Although there are highly effective GBDT implementations, their scalability to such problems is still unsatisfactory. In this paper, we propose novel methods aiming to accelerate the training process of GBDT in the multioutput scenario. The idea behind these methods lies in the approximate computation of a scoring function used to find the best split of decision trees. These methods are implemented in SketchBoost, which itself is integrated into our easily customizable Python-based GPU implementation of GBDT called Py-Boost. Our numerical study demonstrates that SketchBoost speeds up the training process of GBDT by up to over 40 times while achieving comparable or even better performance.</p>\n<p>It easy to install: <a href=\"https://pypi.org/project/py-boost/\" target=\"_blank\">pip install py-boost</a></p>\n<p>It easy to use - see tutorial notebooks:  <a href=\"https://www.kaggle.com/code/alexandervc/pyboost-secret-grandmaster-s-tool\" target=\"_blank\">Kaggle Open problems notebook</a>,  <a href=\"https://github.com/AILab-MLTools/Py-Boost/blob/master/tutorials/Tutorial_1_Basics.ipynb\" target=\"_blank\">Tutorial_1_Basics</a>, <a href=\"https://github.com/AILab-MLTools/Py-Boost/blob/master/tutorials/Tutorial_2_Advanced_multioutput.ipynb\" target=\"_blank\">Tutorial_2_Advanced_multioutput</a>, <a href=\"https://github.com/AILab-MLTools/Py-Boost/blob/master/tutorials/Tutorial_3_Custom_features.ipynb\" target=\"_blank\">Tutorial_3_Custom_features</a></p>\n<p><a href=\"https://github.com/sb-ai-lab/Py-Boost\" target=\"_blank\">Github</a> </p>\n<p><a href=\"https://openreview.net/forum?id=WSxarC8t-T\" target=\"_blank\">Paper</a>: Iosipoi, Leonid, and Anton Vakhrushev. \"SketchBoost: Fast Gradient Boosted Decision Tree for Multioutput Problems.\" Advances in Neural Information Processing Systems 35 (2022): 25422-25435. </p>\n<p>Gold medals on Kaggle: CAFA5 (<a href=\"https://www.kaggle.com/competitions/cafa-5-protein-function-prediction/discussion/434064\" target=\"_blank\">https://www.kaggle.com/competitions/cafa-5-protein-function-prediction/discussion/434064</a>) , Open problems - single cell perturbations 2023 (<a href=\"https://www.kaggle.com/competitions/open-problems-single-cell-perturbations/discussion/460191)\" target=\"_blank\">https://www.kaggle.com/competitions/open-problems-single-cell-perturbations/discussion/460191)</a>, Open problems  2022 (<a href=\"https://www.kaggle.com/competitions/open-problems-multimodal/discussion/366471)\" target=\"_blank\">https://www.kaggle.com/competitions/open-problems-multimodal/discussion/366471)</a>,<br>\nLots of silver/bronze medals in recent Open problems 2023 were based on Pyboost. </p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2F5c77063ce282211b9e0d6cb08e65f4a5%2Fphoto_2023-12-08_10-04-00.jpg?generation=1702029847880152&amp;alt=media\" alt=\"\"></p>\n<hr>\n<p>📹 Video:  <a href=\"https://youtu.be/lcc5vY-Pycs?si=NDz8KEarMFN8Llka\" target=\"_blank\">https://youtu.be/lcc5vY-Pycs?si=NDz8KEarMFN8Llka</a></p>\n<p>👨‍🔬  Antonina Dolgorukova \"Single Cell Perturbations data analysis with Seurat\"<br>\n⌚️ Monday 06 November, 17.00 (CET time)</p>\n<p><a href=\"https://calendar.google.com/calendar/render?action=TEMPLATE&amp;dates=20231106T160000Z%2F20231106T173000Z&amp;details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&amp;text=%20Antonina%20Dolgorukova%20%22Single%20Cell%20Perturbations%20data%20analysis%22\" target=\"_blank\">Add to google calendar</a></p>\n<p>Antonina will share outcomes of here analysis based on the following notebook:<br>\n<a href=\"https://www.kaggle.com/code/antoninadolgorukova/op2-adata-analysis-with-seurat\" target=\"_blank\">https://www.kaggle.com/code/antoninadolgorukova/op2-adata-analysis-with-seurat</a></p>\n<ul>\n<li>Calculation of Mitochondrial/ribosomal contamination (all cells), what percentage of all genes copies comes from the single most observed gene in each cell (10% of cells)</li>\n<li>Identification of highly variable features, followed by PCA, selection of principles components (10% of cells)</li>\n<li>Clustering cells based on main PC for the highly variable features</li>\n<li>Running non-linear dimensional reduction (UMAP/tSNE)</li>\n</ul>\n<p>On twitter: <a href=\"https://x.com/sberloga/status/1720895499559985164?s=20\" target=\"_blank\">https://x.com/sberloga/status/1720895499559985164?s=20</a></p>\n<p>Zoom link will be available here 5 minutes before the start.<br>\nVideo record will be available on the youtube channel soon afterwards: <a href=\"https://www.youtube.com/c/SciBerloga\" target=\"_blank\">https://www.youtube.com/c/SciBerloga</a></p>\n<hr>\n<p>📹 Video:  <a href=\"https://youtu.be/6ySKxnjHX8Y?si=ICiv26d7j1LbYaKn\" target=\"_blank\">https://youtu.be/6ySKxnjHX8Y?si=ICiv26d7j1LbYaKn</a></p>\n<p>👨‍🔬  Brainstorm on  \"Kaggle: Open Problems - Single-Cell Perturbations.\"<br>\n⌚️ Tuesday 17 October, 17.30 (CET time)</p>\n<p><a href=\"https://calendar.google.com/calendar/render?action=TEMPLATE&amp;dates=20231017T153000Z%2F20231017T173000Z&amp;details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&amp;text=%20%20%20Brainstorm%20on%20%20%22Kaggle%3A%20Open%20Problems%20-%20Single-Cell%20Perturbations.%22\" target=\"_blank\">Add to Google Calendar</a></p>\n<p>Let us discuss what's up on Kaggle challenge - Open Problems - Single-Cell Perturbations: overview proposed public solutions, CV-schemes, features constructions, some insights from biological data and so on. It is planned to be pretty informal - a kind of discussion and opinions exchange - everybody welcome. Some notes can be found <a href=\"https://docs.google.com/presentation/d/1wiz0Wmt4D54pqMMsIOyJHuQYMZ3hTBZQQnjbLzwoGYY/edit?usp=sharing\" target=\"_blank\">link1</a>, <a href=\"https://docs.google.com/spreadsheets/d/1APN63PMaWZygVjYimK9Ivt0RvifdAU5JRYkxiDn4szw/edit?usp=sharing\" target=\"_blank\">link2</a>, <a href=\"https://www.kaggle.com/competitions/open-problems-single-cell-perturbations/discussion/445883\" target=\"_blank\">link3</a>.</p>\n<p>Zoom link will be available here 5 minutes before the start. <br>\nVideo record will be available on the youtube channel soon afterwards: <a href=\"https://www.youtube.com/c/SciBerloga\" target=\"_blank\">https://www.youtube.com/c/SciBerloga</a> </p>\n<p>==============================================================</p>\n<p>📹 Video: <a href=\"https://youtu.be/dRG3qTaALp0?si=c6k6CARJuik-xF08\" target=\"_blank\">https://youtu.be/dRG3qTaALp0?si=c6k6CARJuik-xF08</a><br>\n📖 Presentation: A.Chervov: <a href=\"https://docs.google.com/presentation/d/1wiz0Wmt4D54pqMMsIOyJHuQYMZ3hTBZQQnjbLzwoGYY/edit?usp=sharing\" target=\"_blank\">https://docs.google.com/presentation/d/1wiz0Wmt4D54pqMMsIOyJHuQYMZ3hTBZQQnjbLzwoGYY/edit?usp=sharing</a><br>\n📖 Presentation: A.Dolgorukova \"Molecular descriptors\": <a href=\"https://docs.google.com/presentation/d/1H7qL73UrRY3tjpSM3aPxIgETBeMkKzid/edit?usp=sharing&amp;ouid=114126852933828504381&amp;rtpof=true&amp;sd=true\" target=\"_blank\">https://docs.google.com/presentation/d/1H7qL73UrRY3tjpSM3aPxIgETBeMkKzid/edit?usp=sharing&amp;ouid=114126852933828504381&amp;rtpof=true&amp;sd=true</a> </p>\n<p>Everybody is welcome to informal webinar around the competition. Everybody is welcome to share experience or take part in the discussion. Video records will be placed on youtube soon afterwards. Some webinars related to the last year \"Open problems\" Kaggle competition and several other challenges can be found here: <a href=\"https://www.youtube.com/playlist?list=PL1GnA8S_asBANHU95kOPOPEh3moPm5uhw\" target=\"_blank\">https://www.youtube.com/playlist?list=PL1GnA8S_asBANHU95kOPOPEh3moPm5uhw</a> </p>\n<p>Let us start with some introductory webinar: </p>\n<p>👨‍🔬  Alexander Chervov \"Introduction to Kaggle competition - Single-Cell Perturbations (https://www.kaggle.com/competitions/open-problems-single-cell-perturbations).\"<br>\n⌚️ Thursday 5 October, 18.00 (CET time, e.g. Paris )</p>\n<p><a href=\"https://calendar.google.com/calendar/render?action=TEMPLATE&amp;dates=20231005T160000Z%2F20231005T173000Z&amp;details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&amp;text=%20Alexander%20Chervov%20%22Introduction%20to%20Kaggle%20competition%20-%20Single-Cell%20Perturbations\" target=\"_blank\">Add to Google Calendar</a></p>\n<p>We will give brief introduction mainly from machine learning perspective. Task contains  614 samples in train and 255 in test, with only two features, which both are categorical (cell type, and drug). Metric is MMSE (row wise). Cross-validation - by cell types with modifications. Baselines with  encoding categorical features - one-hot, target encoding with optimization of smoothing parameter, pytorch embedding neural network. Alternative features: \"ChemBert\" ( link (<a href=\"https://www.kaggle.com/competitions/open-problems-single-cell-perturbations/discussion/441550\" target=\"_blank\">https://www.kaggle.com/competitions/open-problems-single-cell-perturbations/discussion/441550</a>) - by Aleksey Trepetsky),  molecular descriptors ( link (<a href=\"https://www.kaggle.com/code/antoninadolgorukova/op2-feature-engineering\" target=\"_blank\">https://www.kaggle.com/code/antoninadolgorukova/op2-feature-engineering</a>) by   Antonina Dolgorukova), etc.  Most of approaches use dimensional reduction (pca-like) of targets  (18211) to smaller dimension 25-100, then predicting these reduced target and then making inverse transform.     Notebooks: EDA (<a href=\"https://www.kaggle.com/code/alexandervc/op2-eda-baseline-s\" target=\"_blank\">https://www.kaggle.com/code/alexandervc/op2-eda-baseline-s</a>) ,  modeling (<a href=\"https://www.kaggle.com/code/alexandervc/op2-models-cv-tuning\" target=\"_blank\">https://www.kaggle.com/code/alexandervc/op2-models-cv-tuning</a>)  , pytorch embeddings (<a href=\"https://www.kaggle.com/code/alexandervc/op2-pytorch-embeddings-for-beginners\" target=\"_blank\">https://www.kaggle.com/code/alexandervc/op2-pytorch-embeddings-for-beginners</a>) , single cell RNA-seq data brief look (<a href=\"https://www.kaggle.com/code/alexandervc/op2-rna-seq-data-scanpy-adata-cell-cycle)\" target=\"_blank\">https://www.kaggle.com/code/alexandervc/op2-rna-seq-data-scanpy-adata-cell-cycle)</a>.<br>\nUnusual: 50 000$$  - for biologically insightful solutions which will shed light on  \"How did you integrate the ATAC data? Did you learn a gene regulatory network?\" etc.  </p>\n<p>Zoom link will be available here 5 minutes before the start. </p>",
  "messages": [
    {
      "id": "2466416",
      "postDate": "10/03/2023 19:18:12",
      "content": "<p>📹 Video: <a href=\"https://youtu.be/5xRxuDh_cGk\" target=\"_blank\">https://youtu.be/5xRxuDh_cGk</a><br>\n📖 Presentation: <a href=\"https://t.me/sberlogacompete/10211\" target=\"_blank\">https://t.me/sberlogacompete/10211</a></p>\n<p>Pyboost has been used by many during the competition. Happy to invite everybody to a webinar where its creator Anton Vakhrushev will explain more on it: </p>\n<p>👨‍🔬 Anton Vakhrushev \"SketchBoost: Fast Gradient Boosted Decision Tree for Multioutput Problems\"<br>\n⌚️ Monday 11 December 17.00 (CET time)</p>\n<p><a href=\"https://calendar.google.com/calendar/render?action=TEMPLATE&amp;dates=20231211T160000Z%2F20231211T173000Z&amp;details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&amp;text=Anton%20Vakhrushev%20%22SketchBoost%3A%20Fast%20Gradient%20Boosted%20Decision%20Tree%20for%20Multioutput%20Problems%22\" target=\"_blank\">Add to Google Calendar</a></p>\n<p>Twitter: <a href=\"https://x.com/sberloga/status/1733589792024080479?s=20\" target=\"_blank\">https://x.com/sberloga/status/1733589792024080479?s=20</a><br>\nWould be happy for retwit </p>\n<p>Gradient Boosted Decision Tree (GBDT) is a widely-used machine learning algorithm that has been shown to achieve state-of-the-art results on many standard data science problems. We are interested in its application to multioutput problems when the output is highly multidimensional. Although there are highly effective GBDT implementations, their scalability to such problems is still unsatisfactory. In this paper, we propose novel methods aiming to accelerate the training process of GBDT in the multioutput scenario. The idea behind these methods lies in the approximate computation of a scoring function used to find the best split of decision trees. These methods are implemented in SketchBoost, which itself is integrated into our easily customizable Python-based GPU implementation of GBDT called Py-Boost. Our numerical study demonstrates that SketchBoost speeds up the training process of GBDT by up to over 40 times while achieving comparable or even better performance.</p>\n<p>It easy to install: <a href=\"https://pypi.org/project/py-boost/\" target=\"_blank\">pip install py-boost</a></p>\n<p>It easy to use - see tutorial notebooks:  <a href=\"https://www.kaggle.com/code/alexandervc/pyboost-secret-grandmaster-s-tool\" target=\"_blank\">Kaggle Open problems notebook</a>,  <a href=\"https://github.com/AILab-MLTools/Py-Boost/blob/master/tutorials/Tutorial_1_Basics.ipynb\" target=\"_blank\">Tutorial_1_Basics</a>, <a href=\"https://github.com/AILab-MLTools/Py-Boost/blob/master/tutorials/Tutorial_2_Advanced_multioutput.ipynb\" target=\"_blank\">Tutorial_2_Advanced_multioutput</a>, <a href=\"https://github.com/AILab-MLTools/Py-Boost/blob/master/tutorials/Tutorial_3_Custom_features.ipynb\" target=\"_blank\">Tutorial_3_Custom_features</a></p>\n<p><a href=\"https://github.com/sb-ai-lab/Py-Boost\" target=\"_blank\">Github</a> </p>\n<p><a href=\"https://openreview.net/forum?id=WSxarC8t-T\" target=\"_blank\">Paper</a>: Iosipoi, Leonid, and Anton Vakhrushev. \"SketchBoost: Fast Gradient Boosted Decision Tree for Multioutput Problems.\" Advances in Neural Information Processing Systems 35 (2022): 25422-25435. </p>\n<p>Gold medals on Kaggle: CAFA5 (<a href=\"https://www.kaggle.com/competitions/cafa-5-protein-function-prediction/discussion/434064\" target=\"_blank\">https://www.kaggle.com/competitions/cafa-5-protein-function-prediction/discussion/434064</a>) , Open problems - single cell perturbations 2023 (<a href=\"https://www.kaggle.com/competitions/open-problems-single-cell-perturbations/discussion/460191)\" target=\"_blank\">https://www.kaggle.com/competitions/open-problems-single-cell-perturbations/discussion/460191)</a>, Open problems  2022 (<a href=\"https://www.kaggle.com/competitions/open-problems-multimodal/discussion/366471)\" target=\"_blank\">https://www.kaggle.com/competitions/open-problems-multimodal/discussion/366471)</a>,<br>\nLots of silver/bronze medals in recent Open problems 2023 were based on Pyboost. </p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2F5c77063ce282211b9e0d6cb08e65f4a5%2Fphoto_2023-12-08_10-04-00.jpg?generation=1702029847880152&amp;alt=media\" alt=\"\"></p>\n<hr>\n<p>📹 Video:  <a href=\"https://youtu.be/lcc5vY-Pycs?si=NDz8KEarMFN8Llka\" target=\"_blank\">https://youtu.be/lcc5vY-Pycs?si=NDz8KEarMFN8Llka</a></p>\n<p>👨‍🔬  Antonina Dolgorukova \"Single Cell Perturbations data analysis with Seurat\"<br>\n⌚️ Monday 06 November, 17.00 (CET time)</p>\n<p><a href=\"https://calendar.google.com/calendar/render?action=TEMPLATE&amp;dates=20231106T160000Z%2F20231106T173000Z&amp;details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&amp;text=%20Antonina%20Dolgorukova%20%22Single%20Cell%20Perturbations%20data%20analysis%22\" target=\"_blank\">Add to google calendar</a></p>\n<p>Antonina will share outcomes of here analysis based on the following notebook:<br>\n<a href=\"https://www.kaggle.com/code/antoninadolgorukova/op2-adata-analysis-with-seurat\" target=\"_blank\">https://www.kaggle.com/code/antoninadolgorukova/op2-adata-analysis-with-seurat</a></p>\n<ul>\n<li>Calculation of Mitochondrial/ribosomal contamination (all cells), what percentage of all genes copies comes from the single most observed gene in each cell (10% of cells)</li>\n<li>Identification of highly variable features, followed by PCA, selection of principles components (10% of cells)</li>\n<li>Clustering cells based on main PC for the highly variable features</li>\n<li>Running non-linear dimensional reduction (UMAP/tSNE)</li>\n</ul>\n<p>On twitter: <a href=\"https://x.com/sberloga/status/1720895499559985164?s=20\" target=\"_blank\">https://x.com/sberloga/status/1720895499559985164?s=20</a></p>\n<p>Zoom link will be available here 5 minutes before the start.<br>\nVideo record will be available on the youtube channel soon afterwards: <a href=\"https://www.youtube.com/c/SciBerloga\" target=\"_blank\">https://www.youtube.com/c/SciBerloga</a></p>\n<hr>\n<p>📹 Video:  <a href=\"https://youtu.be/6ySKxnjHX8Y?si=ICiv26d7j1LbYaKn\" target=\"_blank\">https://youtu.be/6ySKxnjHX8Y?si=ICiv26d7j1LbYaKn</a></p>\n<p>👨‍🔬  Brainstorm on  \"Kaggle: Open Problems - Single-Cell Perturbations.\"<br>\n⌚️ Tuesday 17 October, 17.30 (CET time)</p>\n<p><a href=\"https://calendar.google.com/calendar/render?action=TEMPLATE&amp;dates=20231017T153000Z%2F20231017T173000Z&amp;details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&amp;text=%20%20%20Brainstorm%20on%20%20%22Kaggle%3A%20Open%20Problems%20-%20Single-Cell%20Perturbations.%22\" target=\"_blank\">Add to Google Calendar</a></p>\n<p>Let us discuss what's up on Kaggle challenge - Open Problems - Single-Cell Perturbations: overview proposed public solutions, CV-schemes, features constructions, some insights from biological data and so on. It is planned to be pretty informal - a kind of discussion and opinions exchange - everybody welcome. Some notes can be found <a href=\"https://docs.google.com/presentation/d/1wiz0Wmt4D54pqMMsIOyJHuQYMZ3hTBZQQnjbLzwoGYY/edit?usp=sharing\" target=\"_blank\">link1</a>, <a href=\"https://docs.google.com/spreadsheets/d/1APN63PMaWZygVjYimK9Ivt0RvifdAU5JRYkxiDn4szw/edit?usp=sharing\" target=\"_blank\">link2</a>, <a href=\"https://www.kaggle.com/competitions/open-problems-single-cell-perturbations/discussion/445883\" target=\"_blank\">link3</a>.</p>\n<p>Zoom link will be available here 5 minutes before the start. <br>\nVideo record will be available on the youtube channel soon afterwards: <a href=\"https://www.youtube.com/c/SciBerloga\" target=\"_blank\">https://www.youtube.com/c/SciBerloga</a> </p>\n<p>==============================================================</p>\n<p>📹 Video: <a href=\"https://youtu.be/dRG3qTaALp0?si=c6k6CARJuik-xF08\" target=\"_blank\">https://youtu.be/dRG3qTaALp0?si=c6k6CARJuik-xF08</a><br>\n📖 Presentation: A.Chervov: <a href=\"https://docs.google.com/presentation/d/1wiz0Wmt4D54pqMMsIOyJHuQYMZ3hTBZQQnjbLzwoGYY/edit?usp=sharing\" target=\"_blank\">https://docs.google.com/presentation/d/1wiz0Wmt4D54pqMMsIOyJHuQYMZ3hTBZQQnjbLzwoGYY/edit?usp=sharing</a><br>\n📖 Presentation: A.Dolgorukova \"Molecular descriptors\": <a href=\"https://docs.google.com/presentation/d/1H7qL73UrRY3tjpSM3aPxIgETBeMkKzid/edit?usp=sharing&amp;ouid=114126852933828504381&amp;rtpof=true&amp;sd=true\" target=\"_blank\">https://docs.google.com/presentation/d/1H7qL73UrRY3tjpSM3aPxIgETBeMkKzid/edit?usp=sharing&amp;ouid=114126852933828504381&amp;rtpof=true&amp;sd=true</a> </p>\n<p>Everybody is welcome to informal webinar around the competition. Everybody is welcome to share experience or take part in the discussion. Video records will be placed on youtube soon afterwards. Some webinars related to the last year \"Open problems\" Kaggle competition and several other challenges can be found here: <a href=\"https://www.youtube.com/playlist?list=PL1GnA8S_asBANHU95kOPOPEh3moPm5uhw\" target=\"_blank\">https://www.youtube.com/playlist?list=PL1GnA8S_asBANHU95kOPOPEh3moPm5uhw</a> </p>\n<p>Let us start with some introductory webinar: </p>\n<p>👨‍🔬  Alexander Chervov \"Introduction to Kaggle competition - Single-Cell Perturbations (https://www.kaggle.com/competitions/open-problems-single-cell-perturbations).\"<br>\n⌚️ Thursday 5 October, 18.00 (CET time, e.g. Paris )</p>\n<p><a href=\"https://calendar.google.com/calendar/render?action=TEMPLATE&amp;dates=20231005T160000Z%2F20231005T173000Z&amp;details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&amp;text=%20Alexander%20Chervov%20%22Introduction%20to%20Kaggle%20competition%20-%20Single-Cell%20Perturbations\" target=\"_blank\">Add to Google Calendar</a></p>\n<p>We will give brief introduction mainly from machine learning perspective. Task contains  614 samples in train and 255 in test, with only two features, which both are categorical (cell type, and drug). Metric is MMSE (row wise). Cross-validation - by cell types with modifications. Baselines with  encoding categorical features - one-hot, target encoding with optimization of smoothing parameter, pytorch embedding neural network. Alternative features: \"ChemBert\" ( link (<a href=\"https://www.kaggle.com/competitions/open-problems-single-cell-perturbations/discussion/441550\" target=\"_blank\">https://www.kaggle.com/competitions/open-problems-single-cell-perturbations/discussion/441550</a>) - by Aleksey Trepetsky),  molecular descriptors ( link (<a href=\"https://www.kaggle.com/code/antoninadolgorukova/op2-feature-engineering\" target=\"_blank\">https://www.kaggle.com/code/antoninadolgorukova/op2-feature-engineering</a>) by   Antonina Dolgorukova), etc.  Most of approaches use dimensional reduction (pca-like) of targets  (18211) to smaller dimension 25-100, then predicting these reduced target and then making inverse transform.     Notebooks: EDA (<a href=\"https://www.kaggle.com/code/alexandervc/op2-eda-baseline-s\" target=\"_blank\">https://www.kaggle.com/code/alexandervc/op2-eda-baseline-s</a>) ,  modeling (<a href=\"https://www.kaggle.com/code/alexandervc/op2-models-cv-tuning\" target=\"_blank\">https://www.kaggle.com/code/alexandervc/op2-models-cv-tuning</a>)  , pytorch embeddings (<a href=\"https://www.kaggle.com/code/alexandervc/op2-pytorch-embeddings-for-beginners\" target=\"_blank\">https://www.kaggle.com/code/alexandervc/op2-pytorch-embeddings-for-beginners</a>) , single cell RNA-seq data brief look (<a href=\"https://www.kaggle.com/code/alexandervc/op2-rna-seq-data-scanpy-adata-cell-cycle)\" target=\"_blank\">https://www.kaggle.com/code/alexandervc/op2-rna-seq-data-scanpy-adata-cell-cycle)</a>.<br>\nUnusual: 50 000$$  - for biologically insightful solutions which will shed light on  \"How did you integrate the ATAC data? Did you learn a gene regulatory network?\" etc.  </p>\n<p>Zoom link will be available here 5 minutes before the start. </p>",
      "rawMarkdown": "📹 Video: https://youtu.be/5xRxuDh_cGk\n📖 Presentation: https://t.me/sberlogacompete/10211\n\nPyboost has been used by many during the competition. Happy to invite everybody to a webinar where its creator Anton Vakhrushev will explain more on it: \n\n👨‍🔬 Anton Vakhrushev \"SketchBoost: Fast Gradient Boosted Decision Tree for Multioutput Problems\"\n⌚️ Monday 11 December 17.00 (CET time)\n\n[Add to Google Calendar](https://calendar.google.com/calendar/render?action=TEMPLATE&dates=20231211T160000Z%2F20231211T173000Z&details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&text=Anton%20Vakhrushev%20%22SketchBoost%3A%20Fast%20Gradient%20Boosted%20Decision%20Tree%20for%20Multioutput%20Problems%22)\n\nTwitter: https://x.com/sberloga/status/1733589792024080479?s=20\nWould be happy for retwit \n\nGradient Boosted Decision Tree (GBDT) is a widely-used machine learning algorithm that has been shown to achieve state-of-the-art results on many standard data science problems. We are interested in its application to multioutput problems when the output is highly multidimensional. Although there are highly effective GBDT implementations, their scalability to such problems is still unsatisfactory. In this paper, we propose novel methods aiming to accelerate the training process of GBDT in the multioutput scenario. The idea behind these methods lies in the approximate computation of a scoring function used to find the best split of decision trees. These methods are implemented in SketchBoost, which itself is integrated into our easily customizable Python-based GPU implementation of GBDT called Py-Boost. Our numerical study demonstrates that SketchBoost speeds up the training process of GBDT by up to over 40 times while achieving comparable or even better performance.\n\nIt easy to install: [pip install py-boost](https://pypi.org/project/py-boost/)\n\nIt easy to use - see tutorial notebooks:  [Kaggle Open problems notebook](https://www.kaggle.com/code/alexandervc/pyboost-secret-grandmaster-s-tool),  [Tutorial_1_Basics](https://github.com/AILab-MLTools/Py-Boost/blob/master/tutorials/Tutorial_1_Basics.ipynb), [Tutorial_2_Advanced_multioutput](https://github.com/AILab-MLTools/Py-Boost/blob/master/tutorials/Tutorial_2_Advanced_multioutput.ipynb), [Tutorial_3_Custom_features](https://github.com/AILab-MLTools/Py-Boost/blob/master/tutorials/Tutorial_3_Custom_features.ipynb)\n\n[Github](https://github.com/sb-ai-lab/Py-Boost) \n\n[Paper](https://openreview.net/forum?id=WSxarC8t-T): Iosipoi, Leonid, and Anton Vakhrushev. \"SketchBoost: Fast Gradient Boosted Decision Tree for Multioutput Problems.\" Advances in Neural Information Processing Systems 35 (2022): 25422-25435. \n\nGold medals on Kaggle: CAFA5 (https://www.kaggle.com/competitions/cafa-5-protein-function-prediction/discussion/434064) , Open problems - single cell perturbations 2023 (https://www.kaggle.com/competitions/open-problems-single-cell-perturbations/discussion/460191), Open problems  2022 (https://www.kaggle.com/competitions/open-problems-multimodal/discussion/366471),\nLots of silver/bronze medals in recent Open problems 2023 were based on Pyboost. \n\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2F5c77063ce282211b9e0d6cb08e65f4a5%2Fphoto_2023-12-08_10-04-00.jpg?generation=1702029847880152&alt=media)\n\n------------------------------------------------------------------------------------------------------------------------\n\n📹 Video:  https://youtu.be/lcc5vY-Pycs?si=NDz8KEarMFN8Llka\n\n👨‍🔬  Antonina Dolgorukova \"Single Cell Perturbations data analysis with Seurat\"\n⌚️ Monday 06 November, 17.00 (CET time)\n\n[Add to google calendar](https://calendar.google.com/calendar/render?action=TEMPLATE&dates=20231106T160000Z%2F20231106T173000Z&details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&text=%20Antonina%20Dolgorukova%20%22Single%20Cell%20Perturbations%20data%20analysis%22)\n\nAntonina will share outcomes of here analysis based on the following notebook:\nhttps://www.kaggle.com/code/antoninadolgorukova/op2-adata-analysis-with-seurat\n\n- Calculation of Mitochondrial/ribosomal contamination (all cells), what percentage of all genes copies comes from the single most observed gene in each cell (10% of cells)\n- Identification of highly variable features, followed by PCA, selection of principles components (10% of cells)\n- Clustering cells based on main PC for the highly variable features\n- Running non-linear dimensional reduction (UMAP/tSNE)\n\n\nOn twitter: https://x.com/sberloga/status/1720895499559985164?s=20\n\nZoom link will be available here 5 minutes before the start.\nVideo record will be available on the youtube channel soon afterwards: https://www.youtube.com/c/SciBerloga\n\n--------------------------------------------------------------------\n\n📹 Video:  https://youtu.be/6ySKxnjHX8Y?si=ICiv26d7j1LbYaKn\n\n👨‍🔬  Brainstorm on  \"Kaggle: Open Problems - Single-Cell Perturbations.\"\n⌚️ Tuesday 17 October, 17.30 (CET time)\n\n[Add to Google Calendar](https://calendar.google.com/calendar/render?action=TEMPLATE&dates=20231017T153000Z%2F20231017T173000Z&details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&text=%20%20%20Brainstorm%20on%20%20%22Kaggle%3A%20Open%20Problems%20-%20Single-Cell%20Perturbations.%22)\n\n Let us discuss what's up on Kaggle challenge - Open Problems - Single-Cell Perturbations: overview proposed public solutions, CV-schemes, features constructions, some insights from biological data and so on. It is planned to be pretty informal - a kind of discussion and opinions exchange - everybody welcome. Some notes can be found [link1](https://docs.google.com/presentation/d/1wiz0Wmt4D54pqMMsIOyJHuQYMZ3hTBZQQnjbLzwoGYY/edit?usp=sharing), [link2] (https://docs.google.com/spreadsheets/d/1APN63PMaWZygVjYimK9Ivt0RvifdAU5JRYkxiDn4szw/edit?usp=sharing), [link3](https://www.kaggle.com/competitions/open-problems-single-cell-perturbations/discussion/445883).\n\nZoom link will be available here 5 minutes before the start. \nVideo record will be available on the youtube channel soon afterwards: https://www.youtube.com/c/SciBerloga \n\n==============================================================\n\n📹 Video: https://youtu.be/dRG3qTaALp0?si=c6k6CARJuik-xF08\n📖 Presentation: A.Chervov: https://docs.google.com/presentation/d/1wiz0Wmt4D54pqMMsIOyJHuQYMZ3hTBZQQnjbLzwoGYY/edit?usp=sharing\n📖 Presentation: A.Dolgorukova \"Molecular descriptors\": https://docs.google.com/presentation/d/1H7qL73UrRY3tjpSM3aPxIgETBeMkKzid/edit?usp=sharing&ouid=114126852933828504381&rtpof=true&sd=true \n\nEverybody is welcome to informal webinar around the competition. Everybody is welcome to share experience or take part in the discussion. Video records will be placed on youtube soon afterwards. Some webinars related to the last year \"Open problems\" Kaggle competition and several other challenges can be found here: https://www.youtube.com/playlist?list=PL1GnA8S_asBANHU95kOPOPEh3moPm5uhw \n\nLet us start with some introductory webinar: \n\n👨‍🔬  Alexander Chervov \"Introduction to Kaggle competition - Single-Cell Perturbations (https://www.kaggle.com/competitions/open-problems-single-cell-perturbations).\"\n⌚️ Thursday 5 October, 18.00 (CET time, e.g. Paris )\n\n[Add to Google Calendar](https://calendar.google.com/calendar/render?action=TEMPLATE&dates=20231005T160000Z%2F20231005T173000Z&details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&text=%20Alexander%20Chervov%20%22Introduction%20to%20Kaggle%20competition%20-%20Single-Cell%20Perturbations)\n\nWe will give brief introduction mainly from machine learning perspective. Task contains  614 samples in train and 255 in test, with only two features, which both are categorical (cell type, and drug). Metric is MMSE (row wise). Cross-validation - by cell types with modifications. Baselines with  encoding categorical features - one-hot, target encoding with optimization of smoothing parameter, pytorch embedding neural network. Alternative features: \"ChemBert\" ( link (https://www.kaggle.com/competitions/open-problems-single-cell-perturbations/discussion/441550) - by Aleksey Trepetsky),  molecular descriptors ( link (https://www.kaggle.com/code/antoninadolgorukova/op2-feature-engineering) by   Antonina Dolgorukova), etc.  Most of approaches use dimensional reduction (pca-like) of targets  (18211) to smaller dimension 25-100, then predicting these reduced target and then making inverse transform.     Notebooks: EDA (https://www.kaggle.com/code/alexandervc/op2-eda-baseline-s) ,  modeling (https://www.kaggle.com/code/alexandervc/op2-models-cv-tuning)  , pytorch embeddings (https://www.kaggle.com/code/alexandervc/op2-pytorch-embeddings-for-beginners) , single cell RNA-seq data brief look (https://www.kaggle.com/code/alexandervc/op2-rna-seq-data-scanpy-adata-cell-cycle).\nUnusual: 50 000$$  - for biologically insightful solutions which will shed light on  \"How did you integrate the ATAC data? Did you learn a gene regulatory network?\" etc.  \n\n\nZoom link will be available here 5 minutes before the start.",
      "votes": null
    },
    {
      "id": "2467007",
      "postDate": "10/04/2023 08:32:29",
      "content": "<p>Cool, thank you for organizing this!</p>",
      "rawMarkdown": "Cool, thank you for organizing this!",
      "votes": null
    },
    {
      "id": "2468568",
      "postDate": "10/05/2023 15:57:24",
      "content": "<p>Zoom:<br>\n<a href=\"https://us02web.zoom.us/j/87351847201?pwd=WmJwSHRET0M1c2ZRMHZIRHFpMHFWZz09\" target=\"_blank\">https://us02web.zoom.us/j/87351847201?pwd=WmJwSHRET0M1c2ZRMHZIRHFpMHFWZz09</a></p>",
      "rawMarkdown": "Zoom:\nhttps://us02web.zoom.us/j/87351847201?pwd=WmJwSHRET0M1c2ZRMHZIRHFpMHFWZz09",
      "votes": null
    },
    {
      "id": "2468991",
      "postDate": "10/06/2023 03:51:59",
      "content": "<p>The presentation with molecular descriptors explained is here: <a href=\"https://docs.google.com/presentation/d/1H7qL73UrRY3tjpSM3aPxIgETBeMkKzid/edit?usp=sharing&amp;ouid=114126852933828504381&amp;rtpof=true&amp;sd=true\" target=\"_blank\">https://docs.google.com/presentation/d/1H7qL73UrRY3tjpSM3aPxIgETBeMkKzid/edit?usp=sharing&amp;ouid=114126852933828504381&amp;rtpof=true&amp;sd=true</a></p>",
      "rawMarkdown": "The presentation with molecular descriptors explained is here: https://docs.google.com/presentation/d/1H7qL73UrRY3tjpSM3aPxIgETBeMkKzid/edit?usp=sharing&ouid=114126852933828504381&rtpof=true&sd=true",
      "votes": null
    },
    {
      "id": "2469258",
      "postDate": "10/06/2023 08:40:37",
      "content": "<p>📹 Video: <a href=\"https://youtu.be/dRG3qTaALp0?si=c6k6CARJuik-xF08\" target=\"_blank\">https://youtu.be/dRG3qTaALp0?si=c6k6CARJuik-xF08</a><br>\n📖 Presentation: A.Chervov: <a href=\"https://docs.google.com/presentation/d/1wiz0Wmt4D54pqMMsIOyJHuQYMZ3hTBZQQnjbLzwoGYY/edit?usp=sharing\" target=\"_blank\">https://docs.google.com/presentation/d/1wiz0Wmt4D54pqMMsIOyJHuQYMZ3hTBZQQnjbLzwoGYY/edit?usp=sharing</a><br>\n📖 Presentation: A.Dolgorukova \"Molecular descriptors\": <a href=\"https://docs.google.com/presentation/d/1H7qL73UrRY3tjpSM3aPxIgETBeMkKzid/edit?usp=sharing&amp;ouid=114126852933828504381&amp;rtpof=true&amp;sd=true\" target=\"_blank\">https://docs.google.com/presentation/d/1H7qL73UrRY3tjpSM3aPxIgETBeMkKzid/edit?usp=sharing&amp;ouid=114126852933828504381&amp;rtpof=true&amp;sd=true</a> </p>",
      "rawMarkdown": "📹 Video: https://youtu.be/dRG3qTaALp0?si=c6k6CARJuik-xF08\n📖 Presentation: A.Chervov: https://docs.google.com/presentation/d/1wiz0Wmt4D54pqMMsIOyJHuQYMZ3hTBZQQnjbLzwoGYY/edit?usp=sharing\n📖 Presentation: A.Dolgorukova \"Molecular descriptors\": https://docs.google.com/presentation/d/1H7qL73UrRY3tjpSM3aPxIgETBeMkKzid/edit?usp=sharing&ouid=114126852933828504381&rtpof=true&sd=true",
      "votes": null
    },
    {
      "id": "2474195",
      "postDate": "10/09/2023 04:17:58",
      "content": "<p>For now, I have checked the descriptors as is + PCA, in <a href=\"https://www.kaggle.com/code/antoninadolgorukova/op2-bl-submission?scriptVersionId=145674979\" target=\"_blank\">this version</a> of my baseline notebook - LB score is much worse than 0s (0.675).</p>\n<p>It confirms what I said, feature selection is needed here, followed by some standartization/normalization.</p>",
      "rawMarkdown": "For now, I have checked the descriptors as is + PCA, in [this version](https://www.kaggle.com/code/antoninadolgorukova/op2-bl-submission?scriptVersionId=145674979) of my baseline notebook - LB score is much worse than 0s (0.675).\n\nIt confirms what I said, feature selection is needed here, followed by some standartization/normalization.",
      "votes": null
    },
    {
      "id": "2474411",
      "postDate": "10/09/2023 07:30:41",
      "content": "<p>Thank you for the introductory webinar</p>",
      "rawMarkdown": "Thank you for the introductory webinar",
      "votes": null
    },
    {
      "id": "2480625",
      "postDate": "10/13/2023 12:52:43",
      "content": "<p>Thank you, very much! Alexander!</p>",
      "rawMarkdown": "Thank you, very much! Alexander!",
      "votes": null
    },
    {
      "id": "2483559",
      "postDate": "10/15/2023 19:31:30",
      "content": "<p>👨‍🔬  Brainstorm on  \"Kaggle: Open Problems - Single-Cell Perturbations.\"<br>\n⌚️ Tuesday 17 October, 17.30 (CET time)</p>\n<p><a href=\"https://calendar.google.com/calendar/render?action=TEMPLATE&amp;dates=20231017T153000Z%2F20231017T173000Z&amp;details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&amp;text=%20%20%20Brainstorm%20on%20%20%22Kaggle%3A%20Open%20Problems%20-%20Single-Cell%20Perturbations.%22\" target=\"_blank\">Add to Google Calendar</a></p>\n<p>Let us discuss what's up on Kaggle challenge - Open Problems - Single-Cell Perturbations: overview proposed public solutions, CV-schemes, features constructions, some insights from biological data and so on. It is planned to be pretty informal - a kind of discussion and opinions exchange - everybody welcome. Some notes can be found <a href=\"https://docs.google.com/presentation/d/1wiz0Wmt4D54pqMMsIOyJHuQYMZ3hTBZQQnjbLzwoGYY/edit?usp=sharing\" target=\"_blank\">link1</a>, <a href=\"https://docs.google.com/spreadsheets/d/1APN63PMaWZygVjYimK9Ivt0RvifdAU5JRYkxiDn4szw/edit?usp=sharing\" target=\"_blank\">link2</a>, <a href=\"https://www.kaggle.com/competitions/open-problems-single-cell-perturbations/discussion/445883\" target=\"_blank\">link3</a>.</p>\n<p>Zoom link will be available here 5 minutes before the start. <br>\nVideo record will be available on the youtube channel soon afterwards: <a href=\"https://www.youtube.com/c/SciBerloga\" target=\"_blank\">https://www.youtube.com/c/SciBerloga</a> </p>",
      "rawMarkdown": "👨‍🔬  Brainstorm on  \"Kaggle: Open Problems - Single-Cell Perturbations.\"\n⌚️ Tuesday 17 October, 17.30 (CET time)\n\n[Add to Google Calendar](https://calendar.google.com/calendar/render?action=TEMPLATE&dates=20231017T153000Z%2F20231017T173000Z&details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&text=%20%20%20Brainstorm%20on%20%20%22Kaggle%3A%20Open%20Problems%20-%20Single-Cell%20Perturbations.%22)\n\n Let us discuss what's up on Kaggle challenge - Open Problems - Single-Cell Perturbations: overview proposed public solutions, CV-schemes, features constructions, some insights from biological data and so on. It is planned to be pretty informal - a kind of discussion and opinions exchange - everybody welcome. Some notes can be found [link1](https://docs.google.com/presentation/d/1wiz0Wmt4D54pqMMsIOyJHuQYMZ3hTBZQQnjbLzwoGYY/edit?usp=sharing), [link2] (https://docs.google.com/spreadsheets/d/1APN63PMaWZygVjYimK9Ivt0RvifdAU5JRYkxiDn4szw/edit?usp=sharing), [link3](https://www.kaggle.com/competitions/open-problems-single-cell-perturbations/discussion/445883).\n\nZoom link will be available here 5 minutes before the start. \nVideo record will be available on the youtube channel soon afterwards: https://www.youtube.com/c/SciBerloga",
      "votes": null
    },
    {
      "id": "2485975",
      "postDate": "10/17/2023 15:29:47",
      "content": "<p>Zoom link:<br>\n<a href=\"https://us02web.zoom.us/j/81679339241?pwd=M0E2OWk0ZmJ6S2xLNGZoWlVJNEYvdz09\" target=\"_blank\">https://us02web.zoom.us/j/81679339241?pwd=M0E2OWk0ZmJ6S2xLNGZoWlVJNEYvdz09</a></p>",
      "rawMarkdown": "Zoom link:\nhttps://us02web.zoom.us/j/81679339241?pwd=M0E2OWk0ZmJ6S2xLNGZoWlVJNEYvdz09",
      "votes": null
    },
    {
      "id": "2489501",
      "postDate": "10/20/2023 03:27:18",
      "content": "<p><a href=\"https://www.kaggle.com/alexandervc\" target=\"_blank\">@alexandervc</a>   Are these meetings still happening?</p>",
      "rawMarkdown": "alexandervc   Are these meetings still happening?",
      "votes": null
    },
    {
      "id": "2489538",
      "postDate": "10/20/2023 04:13:36",
      "content": "<p>There were two , hopefully there will be more , announces will be here </p>",
      "rawMarkdown": "There were two , hopefully there will be more , announces will be here",
      "votes": null
    },
    {
      "id": "2512754",
      "postDate": "11/04/2023 19:51:25",
      "content": "<p>👨‍🔬  Antonina Dolgorukova \"Single Cell Perturbations data analysis with Seurat\"<br>\n⌚️ Monday 06 November, 17.00 (CET time)</p>\n<p><a href=\"https://calendar.google.com/calendar/render?action=TEMPLATE&amp;dates=20231106T160000Z%2F20231106T173000Z&amp;details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&amp;text=%20Antonina%20Dolgorukova%20%22Single%20Cell%20Perturbations%20data%20analysis%22\" target=\"_blank\">Add to google calendat</a></p>\n<p>Antonina will share outcomes of here analysis based on the following notebook:<br>\n<a href=\"https://www.kaggle.com/code/antoninadolgorukova/op2-adata-analysis-with-seurat\" target=\"_blank\">https://www.kaggle.com/code/antoninadolgorukova/op2-adata-analysis-with-seurat</a></p>\n<p>Zoom link will be available here 5 minutes before the start.<br>\nVideo record will be available on the youtube channel soon afterwards: <a href=\"https://www.youtube.com/c/SciBerloga\" target=\"_blank\">https://www.youtube.com/c/SciBerloga</a></p>",
      "rawMarkdown": "👨‍🔬  Antonina Dolgorukova \"Single Cell Perturbations data analysis with Seurat\"\n⌚️ Monday 06 November, 17.00 (CET time)\n\n[Add to google calendat](https://calendar.google.com/calendar/render?action=TEMPLATE&dates=20231106T160000Z%2F20231106T173000Z&details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&text=%20Antonina%20Dolgorukova%20%22Single%20Cell%20Perturbations%20data%20analysis%22)\n\nAntonina will share outcomes of here analysis based on the following notebook:\nhttps://www.kaggle.com/code/antoninadolgorukova/op2-adata-analysis-with-seurat\n\nZoom link will be available here 5 minutes before the start.\nVideo record will be available on the youtube channel soon afterwards: https://www.youtube.com/c/SciBerloga",
      "votes": null
    },
    {
      "id": "2514918",
      "postDate": "11/06/2023 15:58:13",
      "content": "<p>Zoom link: <a href=\"https://us02web.zoom.us/j/89080226552?pwd=aGc1NElmWlVuZEljYjBaS1pZaUN2QT09\" target=\"_blank\">https://us02web.zoom.us/j/89080226552?pwd=aGc1NElmWlVuZEljYjBaS1pZaUN2QT09</a></p>\n<p>👨‍🔬  Antonina Dolgorukova \"Single Cell Perturbations data analysis with Seurat\"<br>\n⌚️ Monday 06 November, 17.00 (CET time)</p>",
      "rawMarkdown": "Zoom link: https://us02web.zoom.us/j/89080226552?pwd=aGc1NElmWlVuZEljYjBaS1pZaUN2QT09\n\n👨‍🔬  Antonina Dolgorukova \"Single Cell Perturbations data analysis with Seurat\"\n⌚️ Monday 06 November, 17.00 (CET time)",
      "votes": null
    },
    {
      "id": "2515295",
      "postDate": "11/06/2023 20:29:00",
      "content": "<p>📹 Video:  <a href=\"https://youtu.be/lcc5vY-Pycs?si=NDz8KEarMFN8Llka\" target=\"_blank\">https://youtu.be/lcc5vY-Pycs?si=NDz8KEarMFN8Llka</a></p>\n<p>👨‍🔬  Antonina Dolgorukova \"Single Cell Perturbations data analysis with Seurat\"<br>\n⌚️ Monday 06 November, 17.00 (CET time)</p>",
      "rawMarkdown": "📹 Video:  https://youtu.be/lcc5vY-Pycs?si=NDz8KEarMFN8Llka\n\n👨‍🔬  Antonina Dolgorukova \"Single Cell Perturbations data analysis with Seurat\"\n⌚️ Monday 06 November, 17.00 (CET time)",
      "votes": null
    },
    {
      "id": "2518538",
      "postDate": "11/09/2023 12:07:19",
      "content": "<p>Thanks for the webinars <a href=\"https://www.kaggle.com/alexandervc\" target=\"_blank\">@alexandervc</a> - sounds like a quick intro to the competition for people who are late enough :))</p>",
      "rawMarkdown": "Thanks for the webinars @alexandervc - sounds like a quick intro to the competition for people who are late enough :))",
      "votes": null
    },
    {
      "id": "2553491",
      "postDate": "12/08/2023 09:48:59",
      "content": "<p>Pyboost has been used by many during the competition. Happy to invite everybody to a webinar where its creator Anton Vakhrushev will explain more on it: </p>\n<p>👨‍🔬 Anton Vakhrushev \"SketchBoost: Fast Gradient Boosted Decision Tree for Multioutput Problems\"<br>\n⌚️ Monday 11 December 17.00 (CET time)</p>\n<p><a href=\"https://calendar.google.com/calendar/render?action=TEMPLATE&amp;dates=20231211T160000Z%2F20231211T173000Z&amp;details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&amp;text=Anton%20Vakhrushev%20%22SketchBoost%3A%20Fast%20Gradient%20Boosted%20Decision%20Tree%20for%20Multioutput%20Problems%22\" target=\"_blank\">Add to Google Calendar</a></p>\n<p>Twitter: <a href=\"https://x.com/sberloga/status/1733589792024080479?s=20\" target=\"_blank\">https://x.com/sberloga/status/1733589792024080479?s=20</a><br>\nWould be happy for retwit</p>",
      "rawMarkdown": "Pyboost has been used by many during the competition. Happy to invite everybody to a webinar where its creator Anton Vakhrushev will explain more on it: \n\n👨‍🔬 Anton Vakhrushev \"SketchBoost: Fast Gradient Boosted Decision Tree for Multioutput Problems\"\n⌚️ Monday 11 December 17.00 (CET time)\n\n[Add to Google Calendar](https://calendar.google.com/calendar/render?action=TEMPLATE&dates=20231211T160000Z%2F20231211T173000Z&details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&text=Anton%20Vakhrushev%20%22SketchBoost%3A%20Fast%20Gradient%20Boosted%20Decision%20Tree%20for%20Multioutput%20Problems%22)\n\nTwitter: https://x.com/sberloga/status/1733589792024080479?s=20\nWould be happy for retwit",
      "votes": null
    },
    {
      "id": "2557675",
      "postDate": "12/11/2023 15:59:42",
      "content": "<p>Zoom link:<br>\n<a href=\"https://us02web.zoom.us/j/86106703038?pwd=VFBtUm9HTW5wWmFUUTJnUG1scytOQT09\" target=\"_blank\">https://us02web.zoom.us/j/86106703038?pwd=VFBtUm9HTW5wWmFUUTJnUG1scytOQT09</a></p>",
      "rawMarkdown": "Zoom link:\nhttps://us02web.zoom.us/j/86106703038?pwd=VFBtUm9HTW5wWmFUUTJnUG1scytOQT09",
      "votes": null
    },
    {
      "id": "2558549",
      "postDate": "12/12/2023 07:59:59",
      "content": "<p>📹 Video: <a href=\"https://youtu.be/5xRxuDh_cGk\" target=\"_blank\">https://youtu.be/5xRxuDh_cGk</a><br>\n📖 Presentation: <a href=\"https://t.me/sberlogacompete/10211\" target=\"_blank\">https://t.me/sberlogacompete/10211</a></p>\n<p>Pyboost has been used by many during the competition. Happy to invite everybody to a webinar where its creator Anton Vakhrushev will explain more on it:</p>\n<p>👨‍🔬  Anton Vakhrushev, Leonid  Iosipoi \"Pyboost/SketchBoost: Fast Gradient Boosted Decision Tree for Multioutput Problems\"<br>\n⌚️ Monday 11 December 17.00 (CET time)</p>\n<p>Twitter: <a href=\"https://x.com/sberloga/status/1733589792024080479?s=20\" target=\"_blank\">https://x.com/sberloga/status/1733589792024080479?s=20</a></p>",
      "rawMarkdown": "📹 Video: https://youtu.be/5xRxuDh_cGk\n📖 Presentation: https://t.me/sberlogacompete/10211\n\nPyboost has been used by many during the competition. Happy to invite everybody to a webinar where its creator Anton Vakhrushev will explain more on it:\n\n👨‍🔬  Anton Vakhrushev, Leonid  Iosipoi \"Pyboost/SketchBoost: Fast Gradient Boosted Decision Tree for Multioutput Problems\"\n⌚️ Monday 11 December 17.00 (CET time)\n\nTwitter: https://x.com/sberloga/status/1733589792024080479?s=20",
      "votes": null
    },
    {
      "id": "2994862",
      "postDate": "09/21/2024 15:13:29",
      "content": "<p>nice work!</p>",
      "rawMarkdown": "nice work!",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2467007,
      "author_name": "antoninadolgorukova",
      "author_url": "",
      "post_date": "10/04/2023 08:32:29",
      "content": "<p>Cool, thank you for organizing this!</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2468568,
      "author_name": "alexandervc",
      "author_url": "",
      "post_date": "10/05/2023 15:57:24",
      "content": "<p>Zoom:<br>\n<a href=\"https://us02web.zoom.us/j/87351847201?pwd=WmJwSHRET0M1c2ZRMHZIRHFpMHFWZz09\" target=\"_blank\">https://us02web.zoom.us/j/87351847201?pwd=WmJwSHRET0M1c2ZRMHZIRHFpMHFWZz09</a></p>",
      "votes": null,
      "replies": [
        {
          "id": 2480625,
          "author_name": "erotar",
          "author_url": "",
          "post_date": "10/13/2023 12:52:43",
          "content": "<p>Thank you, very much! Alexander!</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2468991,
      "author_name": "antoninadolgorukova",
      "author_url": "",
      "post_date": "10/06/2023 03:51:59",
      "content": "<p>The presentation with molecular descriptors explained is here: <a href=\"https://docs.google.com/presentation/d/1H7qL73UrRY3tjpSM3aPxIgETBeMkKzid/edit?usp=sharing&amp;ouid=114126852933828504381&amp;rtpof=true&amp;sd=true\" target=\"_blank\">https://docs.google.com/presentation/d/1H7qL73UrRY3tjpSM3aPxIgETBeMkKzid/edit?usp=sharing&amp;ouid=114126852933828504381&amp;rtpof=true&amp;sd=true</a></p>",
      "votes": null,
      "replies": [
        {
          "id": 2474195,
          "author_name": "antoninadolgorukova",
          "author_url": "",
          "post_date": "10/09/2023 04:17:58",
          "content": "<p>For now, I have checked the descriptors as is + PCA, in <a href=\"https://www.kaggle.com/code/antoninadolgorukova/op2-bl-submission?scriptVersionId=145674979\" target=\"_blank\">this version</a> of my baseline notebook - LB score is much worse than 0s (0.675).</p>\n<p>It confirms what I said, feature selection is needed here, followed by some standartization/normalization.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2469258,
      "author_name": "alexandervc",
      "author_url": "",
      "post_date": "10/06/2023 08:40:37",
      "content": "<p>📹 Video: <a href=\"https://youtu.be/dRG3qTaALp0?si=c6k6CARJuik-xF08\" target=\"_blank\">https://youtu.be/dRG3qTaALp0?si=c6k6CARJuik-xF08</a><br>\n📖 Presentation: A.Chervov: <a href=\"https://docs.google.com/presentation/d/1wiz0Wmt4D54pqMMsIOyJHuQYMZ3hTBZQQnjbLzwoGYY/edit?usp=sharing\" target=\"_blank\">https://docs.google.com/presentation/d/1wiz0Wmt4D54pqMMsIOyJHuQYMZ3hTBZQQnjbLzwoGYY/edit?usp=sharing</a><br>\n📖 Presentation: A.Dolgorukova \"Molecular descriptors\": <a href=\"https://docs.google.com/presentation/d/1H7qL73UrRY3tjpSM3aPxIgETBeMkKzid/edit?usp=sharing&amp;ouid=114126852933828504381&amp;rtpof=true&amp;sd=true\" target=\"_blank\">https://docs.google.com/presentation/d/1H7qL73UrRY3tjpSM3aPxIgETBeMkKzid/edit?usp=sharing&amp;ouid=114126852933828504381&amp;rtpof=true&amp;sd=true</a> </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2474411,
      "author_name": "mudditharanathunga",
      "author_url": "",
      "post_date": "10/09/2023 07:30:41",
      "content": "<p>Thank you for the introductory webinar</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2483559,
      "author_name": "alexandervc",
      "author_url": "",
      "post_date": "10/15/2023 19:31:30",
      "content": "<p>👨‍🔬  Brainstorm on  \"Kaggle: Open Problems - Single-Cell Perturbations.\"<br>\n⌚️ Tuesday 17 October, 17.30 (CET time)</p>\n<p><a href=\"https://calendar.google.com/calendar/render?action=TEMPLATE&amp;dates=20231017T153000Z%2F20231017T173000Z&amp;details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&amp;text=%20%20%20Brainstorm%20on%20%20%22Kaggle%3A%20Open%20Problems%20-%20Single-Cell%20Perturbations.%22\" target=\"_blank\">Add to Google Calendar</a></p>\n<p>Let us discuss what's up on Kaggle challenge - Open Problems - Single-Cell Perturbations: overview proposed public solutions, CV-schemes, features constructions, some insights from biological data and so on. It is planned to be pretty informal - a kind of discussion and opinions exchange - everybody welcome. Some notes can be found <a href=\"https://docs.google.com/presentation/d/1wiz0Wmt4D54pqMMsIOyJHuQYMZ3hTBZQQnjbLzwoGYY/edit?usp=sharing\" target=\"_blank\">link1</a>, <a href=\"https://docs.google.com/spreadsheets/d/1APN63PMaWZygVjYimK9Ivt0RvifdAU5JRYkxiDn4szw/edit?usp=sharing\" target=\"_blank\">link2</a>, <a href=\"https://www.kaggle.com/competitions/open-problems-single-cell-perturbations/discussion/445883\" target=\"_blank\">link3</a>.</p>\n<p>Zoom link will be available here 5 minutes before the start. <br>\nVideo record will be available on the youtube channel soon afterwards: <a href=\"https://www.youtube.com/c/SciBerloga\" target=\"_blank\">https://www.youtube.com/c/SciBerloga</a> </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2485975,
      "author_name": "alexandervc",
      "author_url": "",
      "post_date": "10/17/2023 15:29:47",
      "content": "<p>Zoom link:<br>\n<a href=\"https://us02web.zoom.us/j/81679339241?pwd=M0E2OWk0ZmJ6S2xLNGZoWlVJNEYvdz09\" target=\"_blank\">https://us02web.zoom.us/j/81679339241?pwd=M0E2OWk0ZmJ6S2xLNGZoWlVJNEYvdz09</a></p>",
      "votes": null,
      "replies": [
        {
          "id": 2489501,
          "author_name": "yantxx",
          "author_url": "",
          "post_date": "10/20/2023 03:27:18",
          "content": "<p><a href=\"https://www.kaggle.com/alexandervc\" target=\"_blank\">@alexandervc</a>   Are these meetings still happening?</p>",
          "votes": null,
          "replies": [
            {
              "id": 2489538,
              "author_name": "alexandervc",
              "author_url": "",
              "post_date": "10/20/2023 04:13:36",
              "content": "<p>There were two , hopefully there will be more , announces will be here </p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 2512754,
      "author_name": "alexandervc",
      "author_url": "",
      "post_date": "11/04/2023 19:51:25",
      "content": "<p>👨‍🔬  Antonina Dolgorukova \"Single Cell Perturbations data analysis with Seurat\"<br>\n⌚️ Monday 06 November, 17.00 (CET time)</p>\n<p><a href=\"https://calendar.google.com/calendar/render?action=TEMPLATE&amp;dates=20231106T160000Z%2F20231106T173000Z&amp;details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&amp;text=%20Antonina%20Dolgorukova%20%22Single%20Cell%20Perturbations%20data%20analysis%22\" target=\"_blank\">Add to google calendat</a></p>\n<p>Antonina will share outcomes of here analysis based on the following notebook:<br>\n<a href=\"https://www.kaggle.com/code/antoninadolgorukova/op2-adata-analysis-with-seurat\" target=\"_blank\">https://www.kaggle.com/code/antoninadolgorukova/op2-adata-analysis-with-seurat</a></p>\n<p>Zoom link will be available here 5 minutes before the start.<br>\nVideo record will be available on the youtube channel soon afterwards: <a href=\"https://www.youtube.com/c/SciBerloga\" target=\"_blank\">https://www.youtube.com/c/SciBerloga</a></p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2514918,
      "author_name": "alexandervc",
      "author_url": "",
      "post_date": "11/06/2023 15:58:13",
      "content": "<p>Zoom link: <a href=\"https://us02web.zoom.us/j/89080226552?pwd=aGc1NElmWlVuZEljYjBaS1pZaUN2QT09\" target=\"_blank\">https://us02web.zoom.us/j/89080226552?pwd=aGc1NElmWlVuZEljYjBaS1pZaUN2QT09</a></p>\n<p>👨‍🔬  Antonina Dolgorukova \"Single Cell Perturbations data analysis with Seurat\"<br>\n⌚️ Monday 06 November, 17.00 (CET time)</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2515295,
      "author_name": "alexandervc",
      "author_url": "",
      "post_date": "11/06/2023 20:29:00",
      "content": "<p>📹 Video:  <a href=\"https://youtu.be/lcc5vY-Pycs?si=NDz8KEarMFN8Llka\" target=\"_blank\">https://youtu.be/lcc5vY-Pycs?si=NDz8KEarMFN8Llka</a></p>\n<p>👨‍🔬  Antonina Dolgorukova \"Single Cell Perturbations data analysis with Seurat\"<br>\n⌚️ Monday 06 November, 17.00 (CET time)</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2518538,
      "author_name": "alexryzhkov",
      "author_url": "",
      "post_date": "11/09/2023 12:07:19",
      "content": "<p>Thanks for the webinars <a href=\"https://www.kaggle.com/alexandervc\" target=\"_blank\">@alexandervc</a> - sounds like a quick intro to the competition for people who are late enough :))</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2553491,
      "author_name": "alexandervc",
      "author_url": "",
      "post_date": "12/08/2023 09:48:59",
      "content": "<p>Pyboost has been used by many during the competition. Happy to invite everybody to a webinar where its creator Anton Vakhrushev will explain more on it: </p>\n<p>👨‍🔬 Anton Vakhrushev \"SketchBoost: Fast Gradient Boosted Decision Tree for Multioutput Problems\"<br>\n⌚️ Monday 11 December 17.00 (CET time)</p>\n<p><a href=\"https://calendar.google.com/calendar/render?action=TEMPLATE&amp;dates=20231211T160000Z%2F20231211T173000Z&amp;details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&amp;text=Anton%20Vakhrushev%20%22SketchBoost%3A%20Fast%20Gradient%20Boosted%20Decision%20Tree%20for%20Multioutput%20Problems%22\" target=\"_blank\">Add to Google Calendar</a></p>\n<p>Twitter: <a href=\"https://x.com/sberloga/status/1733589792024080479?s=20\" target=\"_blank\">https://x.com/sberloga/status/1733589792024080479?s=20</a><br>\nWould be happy for retwit</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2557675,
      "author_name": "alexandervc",
      "author_url": "",
      "post_date": "12/11/2023 15:59:42",
      "content": "<p>Zoom link:<br>\n<a href=\"https://us02web.zoom.us/j/86106703038?pwd=VFBtUm9HTW5wWmFUUTJnUG1scytOQT09\" target=\"_blank\">https://us02web.zoom.us/j/86106703038?pwd=VFBtUm9HTW5wWmFUUTJnUG1scytOQT09</a></p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2558549,
      "author_name": "alexandervc",
      "author_url": "",
      "post_date": "12/12/2023 07:59:59",
      "content": "<p>📹 Video: <a href=\"https://youtu.be/5xRxuDh_cGk\" target=\"_blank\">https://youtu.be/5xRxuDh_cGk</a><br>\n📖 Presentation: <a href=\"https://t.me/sberlogacompete/10211\" target=\"_blank\">https://t.me/sberlogacompete/10211</a></p>\n<p>Pyboost has been used by many during the competition. Happy to invite everybody to a webinar where its creator Anton Vakhrushev will explain more on it:</p>\n<p>👨‍🔬  Anton Vakhrushev, Leonid  Iosipoi \"Pyboost/SketchBoost: Fast Gradient Boosted Decision Tree for Multioutput Problems\"<br>\n⌚️ Monday 11 December 17.00 (CET time)</p>\n<p>Twitter: <a href=\"https://x.com/sberloga/status/1733589792024080479?s=20\" target=\"_blank\">https://x.com/sberloga/status/1733589792024080479?s=20</a></p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2994862,
      "author_name": "",
      "author_url": "",
      "post_date": "09/21/2024 15:13:29",
      "content": "<p>nice work!</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2466416": "📹 Video: https://youtu.be/5xRxuDh_cGk\n📖 Presentation: https://t.me/sberlogacompete/10211\n\nPyboost has been used by many during the competition. Happy to invite everybody to a webinar where its creator Anton Vakhrushev will explain more on it: \n\n👨‍🔬 Anton Vakhrushev \"SketchBoost: Fast Gradient Boosted Decision Tree for Multioutput Problems\"\n⌚️ Monday 11 December 17.00 (CET time)\n\n[Add to Google Calendar](https://calendar.google.com/calendar/render?action=TEMPLATE&dates=20231211T160000Z%2F20231211T173000Z&details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&text=Anton%20Vakhrushev%20%22SketchBoost%3A%20Fast%20Gradient%20Boosted%20Decision%20Tree%20for%20Multioutput%20Problems%22)\n\nTwitter: https://x.com/sberloga/status/1733589792024080479?s=20\nWould be happy for retwit \n\nGradient Boosted Decision Tree (GBDT) is a widely-used machine learning algorithm that has been shown to achieve state-of-the-art results on many standard data science problems. We are interested in its application to multioutput problems when the output is highly multidimensional. Although there are highly effective GBDT implementations, their scalability to such problems is still unsatisfactory. In this paper, we propose novel methods aiming to accelerate the training process of GBDT in the multioutput scenario. The idea behind these methods lies in the approximate computation of a scoring function used to find the best split of decision trees. These methods are implemented in SketchBoost, which itself is integrated into our easily customizable Python-based GPU implementation of GBDT called Py-Boost. Our numerical study demonstrates that SketchBoost speeds up the training process of GBDT by up to over 40 times while achieving comparable or even better performance.\n\nIt easy to install: [pip install py-boost](https://pypi.org/project/py-boost/)\n\nIt easy to use - see tutorial notebooks:  [Kaggle Open problems notebook](https://www.kaggle.com/code/alexandervc/pyboost-secret-grandmaster-s-tool),  [Tutorial_1_Basics](https://github.com/AILab-MLTools/Py-Boost/blob/master/tutorials/Tutorial_1_Basics.ipynb), [Tutorial_2_Advanced_multioutput](https://github.com/AILab-MLTools/Py-Boost/blob/master/tutorials/Tutorial_2_Advanced_multioutput.ipynb), [Tutorial_3_Custom_features](https://github.com/AILab-MLTools/Py-Boost/blob/master/tutorials/Tutorial_3_Custom_features.ipynb)\n\n[Github](https://github.com/sb-ai-lab/Py-Boost) \n\n[Paper](https://openreview.net/forum?id=WSxarC8t-T): Iosipoi, Leonid, and Anton Vakhrushev. \"SketchBoost: Fast Gradient Boosted Decision Tree for Multioutput Problems.\" Advances in Neural Information Processing Systems 35 (2022): 25422-25435. \n\nGold medals on Kaggle: CAFA5 (https://www.kaggle.com/competitions/cafa-5-protein-function-prediction/discussion/434064) , Open problems - single cell perturbations 2023 (https://www.kaggle.com/competitions/open-problems-single-cell-perturbations/discussion/460191), Open problems  2022 (https://www.kaggle.com/competitions/open-problems-multimodal/discussion/366471),\nLots of silver/bronze medals in recent Open problems 2023 were based on Pyboost. \n\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2F5c77063ce282211b9e0d6cb08e65f4a5%2Fphoto_2023-12-08_10-04-00.jpg?generation=1702029847880152&alt=media)\n\n------------------------------------------------------------------------------------------------------------------------\n\n📹 Video:  https://youtu.be/lcc5vY-Pycs?si=NDz8KEarMFN8Llka\n\n👨‍🔬  Antonina Dolgorukova \"Single Cell Perturbations data analysis with Seurat\"\n⌚️ Monday 06 November, 17.00 (CET time)\n\n[Add to google calendar](https://calendar.google.com/calendar/render?action=TEMPLATE&dates=20231106T160000Z%2F20231106T173000Z&details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&text=%20Antonina%20Dolgorukova%20%22Single%20Cell%20Perturbations%20data%20analysis%22)\n\nAntonina will share outcomes of here analysis based on the following notebook:\nhttps://www.kaggle.com/code/antoninadolgorukova/op2-adata-analysis-with-seurat\n\n- Calculation of Mitochondrial/ribosomal contamination (all cells), what percentage of all genes copies comes from the single most observed gene in each cell (10% of cells)\n- Identification of highly variable features, followed by PCA, selection of principles components (10% of cells)\n- Clustering cells based on main PC for the highly variable features\n- Running non-linear dimensional reduction (UMAP/tSNE)\n\n\nOn twitter: https://x.com/sberloga/status/1720895499559985164?s=20\n\nZoom link will be available here 5 minutes before the start.\nVideo record will be available on the youtube channel soon afterwards: https://www.youtube.com/c/SciBerloga\n\n--------------------------------------------------------------------\n\n📹 Video:  https://youtu.be/6ySKxnjHX8Y?si=ICiv26d7j1LbYaKn\n\n👨‍🔬  Brainstorm on  \"Kaggle: Open Problems - Single-Cell Perturbations.\"\n⌚️ Tuesday 17 October, 17.30 (CET time)\n\n[Add to Google Calendar](https://calendar.google.com/calendar/render?action=TEMPLATE&dates=20231017T153000Z%2F20231017T173000Z&details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&text=%20%20%20Brainstorm%20on%20%20%22Kaggle%3A%20Open%20Problems%20-%20Single-Cell%20Perturbations.%22)\n\n Let us discuss what's up on Kaggle challenge - Open Problems - Single-Cell Perturbations: overview proposed public solutions, CV-schemes, features constructions, some insights from biological data and so on. It is planned to be pretty informal - a kind of discussion and opinions exchange - everybody welcome. Some notes can be found [link1](https://docs.google.com/presentation/d/1wiz0Wmt4D54pqMMsIOyJHuQYMZ3hTBZQQnjbLzwoGYY/edit?usp=sharing), [link2] (https://docs.google.com/spreadsheets/d/1APN63PMaWZygVjYimK9Ivt0RvifdAU5JRYkxiDn4szw/edit?usp=sharing), [link3](https://www.kaggle.com/competitions/open-problems-single-cell-perturbations/discussion/445883).\n\nZoom link will be available here 5 minutes before the start. \nVideo record will be available on the youtube channel soon afterwards: https://www.youtube.com/c/SciBerloga \n\n==============================================================\n\n📹 Video: https://youtu.be/dRG3qTaALp0?si=c6k6CARJuik-xF08\n📖 Presentation: A.Chervov: https://docs.google.com/presentation/d/1wiz0Wmt4D54pqMMsIOyJHuQYMZ3hTBZQQnjbLzwoGYY/edit?usp=sharing\n📖 Presentation: A.Dolgorukova \"Molecular descriptors\": https://docs.google.com/presentation/d/1H7qL73UrRY3tjpSM3aPxIgETBeMkKzid/edit?usp=sharing&ouid=114126852933828504381&rtpof=true&sd=true \n\nEverybody is welcome to informal webinar around the competition. Everybody is welcome to share experience or take part in the discussion. Video records will be placed on youtube soon afterwards. Some webinars related to the last year \"Open problems\" Kaggle competition and several other challenges can be found here: https://www.youtube.com/playlist?list=PL1GnA8S_asBANHU95kOPOPEh3moPm5uhw \n\nLet us start with some introductory webinar: \n\n👨‍🔬  Alexander Chervov \"Introduction to Kaggle competition - Single-Cell Perturbations (https://www.kaggle.com/competitions/open-problems-single-cell-perturbations).\"\n⌚️ Thursday 5 October, 18.00 (CET time, e.g. Paris )\n\n[Add to Google Calendar](https://calendar.google.com/calendar/render?action=TEMPLATE&dates=20231005T160000Z%2F20231005T173000Z&details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&text=%20Alexander%20Chervov%20%22Introduction%20to%20Kaggle%20competition%20-%20Single-Cell%20Perturbations)\n\nWe will give brief introduction mainly from machine learning perspective. Task contains  614 samples in train and 255 in test, with only two features, which both are categorical (cell type, and drug). Metric is MMSE (row wise). Cross-validation - by cell types with modifications. Baselines with  encoding categorical features - one-hot, target encoding with optimization of smoothing parameter, pytorch embedding neural network. Alternative features: \"ChemBert\" ( link (https://www.kaggle.com/competitions/open-problems-single-cell-perturbations/discussion/441550) - by Aleksey Trepetsky),  molecular descriptors ( link (https://www.kaggle.com/code/antoninadolgorukova/op2-feature-engineering) by   Antonina Dolgorukova), etc.  Most of approaches use dimensional reduction (pca-like) of targets  (18211) to smaller dimension 25-100, then predicting these reduced target and then making inverse transform.     Notebooks: EDA (https://www.kaggle.com/code/alexandervc/op2-eda-baseline-s) ,  modeling (https://www.kaggle.com/code/alexandervc/op2-models-cv-tuning)  , pytorch embeddings (https://www.kaggle.com/code/alexandervc/op2-pytorch-embeddings-for-beginners) , single cell RNA-seq data brief look (https://www.kaggle.com/code/alexandervc/op2-rna-seq-data-scanpy-adata-cell-cycle).\nUnusual: 50 000$$  - for biologically insightful solutions which will shed light on  \"How did you integrate the ATAC data? Did you learn a gene regulatory network?\" etc.  \n\n\nZoom link will be available here 5 minutes before the start.",
    "2467007": "Cool, thank you for organizing this!",
    "2468568": "Zoom:\nhttps://us02web.zoom.us/j/87351847201?pwd=WmJwSHRET0M1c2ZRMHZIRHFpMHFWZz09",
    "2468991": "The presentation with molecular descriptors explained is here: https://docs.google.com/presentation/d/1H7qL73UrRY3tjpSM3aPxIgETBeMkKzid/edit?usp=sharing&ouid=114126852933828504381&rtpof=true&sd=true",
    "2469258": "📹 Video: https://youtu.be/dRG3qTaALp0?si=c6k6CARJuik-xF08\n📖 Presentation: A.Chervov: https://docs.google.com/presentation/d/1wiz0Wmt4D54pqMMsIOyJHuQYMZ3hTBZQQnjbLzwoGYY/edit?usp=sharing\n📖 Presentation: A.Dolgorukova \"Molecular descriptors\": https://docs.google.com/presentation/d/1H7qL73UrRY3tjpSM3aPxIgETBeMkKzid/edit?usp=sharing&ouid=114126852933828504381&rtpof=true&sd=true",
    "2474195": "For now, I have checked the descriptors as is + PCA, in [this version](https://www.kaggle.com/code/antoninadolgorukova/op2-bl-submission?scriptVersionId=145674979) of my baseline notebook - LB score is much worse than 0s (0.675).\n\nIt confirms what I said, feature selection is needed here, followed by some standartization/normalization.",
    "2474411": "Thank you for the introductory webinar",
    "2480625": "Thank you, very much! Alexander!",
    "2483559": "👨‍🔬  Brainstorm on  \"Kaggle: Open Problems - Single-Cell Perturbations.\"\n⌚️ Tuesday 17 October, 17.30 (CET time)\n\n[Add to Google Calendar](https://calendar.google.com/calendar/render?action=TEMPLATE&dates=20231017T153000Z%2F20231017T173000Z&details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&text=%20%20%20Brainstorm%20on%20%20%22Kaggle%3A%20Open%20Problems%20-%20Single-Cell%20Perturbations.%22)\n\n Let us discuss what's up on Kaggle challenge - Open Problems - Single-Cell Perturbations: overview proposed public solutions, CV-schemes, features constructions, some insights from biological data and so on. It is planned to be pretty informal - a kind of discussion and opinions exchange - everybody welcome. Some notes can be found [link1](https://docs.google.com/presentation/d/1wiz0Wmt4D54pqMMsIOyJHuQYMZ3hTBZQQnjbLzwoGYY/edit?usp=sharing), [link2] (https://docs.google.com/spreadsheets/d/1APN63PMaWZygVjYimK9Ivt0RvifdAU5JRYkxiDn4szw/edit?usp=sharing), [link3](https://www.kaggle.com/competitions/open-problems-single-cell-perturbations/discussion/445883).\n\nZoom link will be available here 5 minutes before the start. \nVideo record will be available on the youtube channel soon afterwards: https://www.youtube.com/c/SciBerloga",
    "2485975": "Zoom link:\nhttps://us02web.zoom.us/j/81679339241?pwd=M0E2OWk0ZmJ6S2xLNGZoWlVJNEYvdz09",
    "2489501": "alexandervc   Are these meetings still happening?",
    "2489538": "There were two , hopefully there will be more , announces will be here",
    "2512754": "👨‍🔬  Antonina Dolgorukova \"Single Cell Perturbations data analysis with Seurat\"\n⌚️ Monday 06 November, 17.00 (CET time)\n\n[Add to google calendat](https://calendar.google.com/calendar/render?action=TEMPLATE&dates=20231106T160000Z%2F20231106T173000Z&details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&text=%20Antonina%20Dolgorukova%20%22Single%20Cell%20Perturbations%20data%20analysis%22)\n\nAntonina will share outcomes of here analysis based on the following notebook:\nhttps://www.kaggle.com/code/antoninadolgorukova/op2-adata-analysis-with-seurat\n\nZoom link will be available here 5 minutes before the start.\nVideo record will be available on the youtube channel soon afterwards: https://www.youtube.com/c/SciBerloga",
    "2514918": "Zoom link: https://us02web.zoom.us/j/89080226552?pwd=aGc1NElmWlVuZEljYjBaS1pZaUN2QT09\n\n👨‍🔬  Antonina Dolgorukova \"Single Cell Perturbations data analysis with Seurat\"\n⌚️ Monday 06 November, 17.00 (CET time)",
    "2515295": "📹 Video:  https://youtu.be/lcc5vY-Pycs?si=NDz8KEarMFN8Llka\n\n👨‍🔬  Antonina Dolgorukova \"Single Cell Perturbations data analysis with Seurat\"\n⌚️ Monday 06 November, 17.00 (CET time)",
    "2518538": "Thanks for the webinars @alexandervc - sounds like a quick intro to the competition for people who are late enough :))",
    "2553491": "Pyboost has been used by many during the competition. Happy to invite everybody to a webinar where its creator Anton Vakhrushev will explain more on it: \n\n👨‍🔬 Anton Vakhrushev \"SketchBoost: Fast Gradient Boosted Decision Tree for Multioutput Problems\"\n⌚️ Monday 11 December 17.00 (CET time)\n\n[Add to Google Calendar](https://calendar.google.com/calendar/render?action=TEMPLATE&dates=20231211T160000Z%2F20231211T173000Z&details=Zoom%20link%20will%20be%20available%20in%20https%3A%2F%2Ft.me%2Fsberlogabig%20%20shortly%20before%20start%20of%20the%20talk.&text=Anton%20Vakhrushev%20%22SketchBoost%3A%20Fast%20Gradient%20Boosted%20Decision%20Tree%20for%20Multioutput%20Problems%22)\n\nTwitter: https://x.com/sberloga/status/1733589792024080479?s=20\nWould be happy for retwit",
    "2557675": "Zoom link:\nhttps://us02web.zoom.us/j/86106703038?pwd=VFBtUm9HTW5wWmFUUTJnUG1scytOQT09",
    "2558549": "📹 Video: https://youtu.be/5xRxuDh_cGk\n📖 Presentation: https://t.me/sberlogacompete/10211\n\nPyboost has been used by many during the competition. Happy to invite everybody to a webinar where its creator Anton Vakhrushev will explain more on it:\n\n👨‍🔬  Anton Vakhrushev, Leonid  Iosipoi \"Pyboost/SketchBoost: Fast Gradient Boosted Decision Tree for Multioutput Problems\"\n⌚️ Monday 11 December 17.00 (CET time)\n\nTwitter: https://x.com/sberloga/status/1733589792024080479?s=20",
    "2994862": "nice work!"
  },
  "source": "meta"
}