{ "id": 348311, "title": "​Лѣтописъ​: regular chronicles of the competition: state of arts, successes, findings, problems - all you wanted to know in one post ", "url": "/competitions/open-problems-multimodal/discussion/348311", "author_name": "Alexander Chervov", "post_date": "2022-08-27T20:58:51.420000", "votes": 51, "comment_count": 21, "views": 0, "content": "

Welcome to add your findings in comments here.

\n

That is was great and hard competition ! Thanks to organizers and congratulations to everybody who gained prizes/medals/experience/fun… !

\n

Day 93 15/11 no change: LB 0.816 Public: 0.812 - the last day of the competition
\nDay 92 14/11 no change: LB 0.816 Public: 0.812 (Incredible fighting top2-10 LB is changing very fast. 9 teams above 0.815, 45 teams above 0.814)
\nDay 91, 13/11 no change: LB 0.816 Public: 0.812 (The fight is very tough top2-5 positions are quite interchanging,
\nsubmissions can be seen every hour. 7 teams above 0.815. 30 teams above 0.814. The poll for shake-up reveals some fears: https://t.me/sberlogacompete/3232 )
\nDay 90, 12/11 no change: LB 0.816 Public: 0.812
\n(The fight for the top2-3 places is very tough - positions were changed several times per day;
\nTeams: [Kha|MT|B|Ambros], [Risk-ZaloPay] Aggressive, [Protein Shake]. 5 Teams above 0.815, 23 teams above 0.814 )
\nDay 88, 10/11 no change: LB 0.815 Public: 0.812
\nDay 87, 9/11 !!! Breakthrough LB 0.816 !!! Public: 0.812 (Senkin&tmp break 0.816. Fourth team achieve 0.815 \"Protein Shake\" E191, 21 team above 0.814 )
\nDay 86, 8/11 no change: LB 0.815 Public: 0.812
\nDay 85, 7/11 no change: LB 0.815 Public: 0.812
\nDay 84, 6/11 no change: LB 0.815 Public: 0.812+ (New top public blend appeared, but still 0.812. Above 0.814 - 19 teams)
\nDay 83, 5/11 no change: LB 0.815 Public: 0.812 (Third team break 0.815 - Kha | MT | B | Ambros E268)
\nDay 82, 4/11 no change: LB 0.815 Public: 0.812
\nDay 81, 3/11 no change: LB 0.815 Public: 0.812 (Dream teamed formed - Senkin13&\"tmp\", top boosting and top NN joined together, any one can beat them ?)
\n(By the way - at the early days of the competition in was written here - look on \"tmp's\"' solution and github:
\n(https://www.kaggle.com/competitions/lish-moa/discussion/202256). It is not too late even now ).
\nDay 80, 2/11 no change: LB 0.815 Public: 0.812 (The first time top1 changed - \"tmp\" 0.815 E39, senkin13 is now top2 0.815 E64)
\nDay 79, 1/11 no change: LB 0.815 Public: 0.812 (\"tmp\" is the second to break 0.815, 18 teams above 0.814, )
\nDay 78, 31/10 no change: LB 0.815 Public: 0.812
\nDay 77, 30/10 no change: LB 0.815 Public: 0.812
\nDay 76, 29/10 no change: LB 0.815 Public: 0.812
\nDay 75, 28/10 no change: LB 0.815 Public: 0.812
\nDay 74, 27/10 no change: LB 0.815 Public: 0.812
\nDay 73, 26/10 no change: LB 0.815 Public: 0.812
\nDay 72, 25/10 no change: LB 0.815 Public: 0.812
\nDay 71, 24/10 no change: LB 0.815 Public: 0.812 (6 teams above 0.814)
\nDay 70, 23/10 no change: LB 0.815 Public: 0.812 (5 teams above 0.814)
\nDay 69, 22/10 no change: LB 0.815 Public: 0.812
\nDay 68, 21/10 no change: LB 0.815 Public: 0.812
\nDay 67, 20/10 no change: LB 0.815 Public: 0.812 , 4-th team achieved 0.814 on LB - \"
\nHow to predict Citeseq\" (user: \"A Beginner\") E238 - Position 4.
\nDay 66, 19/10 !!! Breakthrough LB 0.815 - Senkin13 E55 Public: 0.812 (After 30 days of 0.814 on LB and release of the new data - finally 0.815)
\nDay 65, 18/10 LB 0.814 Public increase: 0.812; The third team achieved 0.814 on LB - \"Protein Shake\" E124. Public 0.812: ( MEHRAN KAZEMINIA Blend achieved 0.812) and another: 0.812 LAURENT POURCHOT
\nDay 64, 17/10 no change: LB 0.814 Public: 0.811
\nDay 63, 16/10 no change: LB 0.814 Public: 0.811
\nDay 62, 15/10 no change: LB 0.814 Public: 0.811
\nDay 61, 14/10 LB 0.814 (Senkin13 E48 - no change) ; small change for public top: : 0.811 (New top public: 0.811+ JUAN SMITH PERERA Adding to the Keras model a grouping based on donor x days. .
\nThe second team reached 0.814: definitelynot KhaVo+MT
\nDay 60, 13/10 no change: LB 0.814 Public: 0.811
\nDay 59, 12/10 no change: LB 0.814 Public: 0.811 . New data has been issued.
\nDay 58, 11/10 no change: LB 0.814 Public: 0.811
\nDay 57, 10/10 no change: LB 0.814 Public: 0.811
\nDay 56, 9/10 no change: LB 0.814 Public: 0.811
\nDay 55, 8/10 no change: LB 0.814 Public: 0.811
\nDay 54, 7/10 no change: LB 0.814 Public: 0.811
\nDay 53, 6/10 no change: LB 0.814 Public: 0.811
\nDay 52, 5/10 no change: LB 0.814 Public: 0.811
\nDay 51, 4/10 no change: LB 0.814 Public: 0.811
\nDay 50, 3/10 no change: LB 0.814 Public: 0.811
\nDay 49, 2/10 no change: LB 0.814 Public: 0.811
\nDay 47, 1/10 no change: LB 0.814 Public: 0.811
\nDay 46, 30/09 no change: LB 0.814 Public: 0.811
\nDay 45, 29/09 no change: LB 0.814 Public: 0.811
\nDay 44, 28/09 no change: LB 0.814 Public: 0.811
\nDay 43, 27/09 no change: LB 0.814 Public: 0.811
\nDay 42, 26/09 no change: LB 0.814 Public: 0.811
\nDay 41, 25/09 no change: LB 0.814 Public: 0.811 ( MT E81 and AmbrosM achieved 0.812 E38 - Top2 and Top4)
\nDay 40, 24/09 no change: LB 0.814 Public: 0.811
\nDay 39, 23/09 no change: LB 0.814 Public: 0.811
\nDay 38, 22/09 no change: LB 0.814 Public: 0.811
\nDay 37, 21/09 no change: LB 0.814 Public: 0.811 (Magnus achieved 0.812 = Top3)
\nDay 36, 20/09 no change: LB 0.814 Public: 0.811
\nDay 35, 19/09 !!! Breakthrough LB 0.814 !!!LB 0.814 (Finally senkin13 achieved 0.814 E27) Public: 0.811
\nDay 34, 18/09 LB 0.813+ Public: 0.811 (new , a little better score, but less blend - Keras + Catboost + some blend)
\nDay 33, 17/09 no change: LB 0.813 Public: 0.811
\nDay 32, 16/09 no change: LB 0.813 Public: 0.811
\nDay 31, 15/09 no change: LB 0.813 Public: 0.811 (Silogram achieved 0.813 E41 , and became N2)
\nDay 30, 14/09 no change: LB 0.813 Public: 0.811
\nDay 29, 13/09 no change: LB 0.813 Public: 0.811
\nDay 28, 12/09 no change: LB 0.813 Public: 0.811
\nDay 27, 11/09 no change: LB 0.813 Public: 0.811
\nDay 26, 10/09 no change: LB 0.813 Public: 0.811
\nDay 25, 09/09 Rescoring process finished (hopefully). The top of LB is basically the same: senkin13: 0.813
\n15, Btbpanda 0.812 25, Mustafa Keser 0.812 79, Silogram 0.812 39. About 0.048 below the old one. Top public: 0.811
\nDay 24, 08/09 Rescoring process not finished yet (restarted)
\nDay 23, 07/09 Data Update and Rescore - exclude data leak. SCORES CHANGE approximately by 0.048 down
\nDay 22, 06/09 LB 0.860 (Btbpanda E25). Public: 0.858 Several. (S: 0.860 35, AC: 0.858 43, AV 0.860 25 S13 0.859 11)
\nDay 21, 05/09 LB 0.860 (Btbpanda E24). Public: 0.858 Several. (S: 0.859 32, AC: 0.858 42, AV 0.860 24 S13 0.859 11)
\nDay 20, 04/09 LB 0.860 (Mustafa Keser E54). Public: 0.858 CITEseq Keras (AMBROSM) (S: 0.859 27, AC: 0.857 36, AV 0.859 22 S13 0.859 8)
\nDay 19, 03/09 LB 0.859 (Btbpanda, E19). Public: 0.853 AMBROSM. Some scores S 0.859, 27, AC 0.855 31, S13 0.854 4
\nDay 18, 02/09 LB Same. Public: 0.848 (Similar to previous top public ) (J. S. Perera). Some scores S: 0.856, 22, AC: 0.850 27
\n Day 17, 01/09 NO change. Some scores S: 0.848 17, AC: 0.849 24
\nDay 16, 31/08 LB: 0.858 (minhtu.mt.mt, E30), Public: 0.847 (PCA+RIDGE on Multiome made Sparse) FABIEN CROM
\nDay 15, 30/08 LB: 0.855 (Jie Wu, E27), same: Public: same : 0.834 (LGBM+Optuna+Drop Const)
\nDay 14, 29/08 same: LB: 0.854 (E25), same: Public: same : 0.834 (LGBM+Optuna+Drop Const)
\nDay 13, 28/08 LB: 0.854 (E25), Public: same : 0.834 (LGBM+Optuna+Drop Const)
\nDay 12, 27/08 LB: 0.848 (E12), Public: 0.834 (LGBM+Optuna+Drop Const)

\n\n

==

\n", "messages": [ { "id": 1916402, "postDate": "2022-08-27T20:58:51.420Z", "content": "

Welcome to add your findings in comments here.

\n

That is was great and hard competition ! Thanks to organizers and congratulations to everybody who gained prizes/medals/experience/fun… !

\n

Day 93 15/11 no change: LB 0.816 Public: 0.812 - the last day of the competition
\nDay 92 14/11 no change: LB 0.816 Public: 0.812 (Incredible fighting top2-10 LB is changing very fast. 9 teams above 0.815, 45 teams above 0.814)
\nDay 91, 13/11 no change: LB 0.816 Public: 0.812 (The fight is very tough top2-5 positions are quite interchanging,
\nsubmissions can be seen every hour. 7 teams above 0.815. 30 teams above 0.814. The poll for shake-up reveals some fears: https://t.me/sberlogacompete/3232 )
\nDay 90, 12/11 no change: LB 0.816 Public: 0.812
\n(The fight for the top2-3 places is very tough - positions were changed several times per day;
\nTeams: [Kha|MT|B|Ambros], [Risk-ZaloPay] Aggressive, [Protein Shake]. 5 Teams above 0.815, 23 teams above 0.814 )
\nDay 88, 10/11 no change: LB 0.815 Public: 0.812
\nDay 87, 9/11 !!! Breakthrough LB 0.816 !!! Public: 0.812 (Senkin&tmp break 0.816. Fourth team achieve 0.815 \"Protein Shake\" E191, 21 team above 0.814 )
\nDay 86, 8/11 no change: LB 0.815 Public: 0.812
\nDay 85, 7/11 no change: LB 0.815 Public: 0.812
\nDay 84, 6/11 no change: LB 0.815 Public: 0.812+ (New top public blend appeared, but still 0.812. Above 0.814 - 19 teams)
\nDay 83, 5/11 no change: LB 0.815 Public: 0.812 (Third team break 0.815 - Kha | MT | B | Ambros E268)
\nDay 82, 4/11 no change: LB 0.815 Public: 0.812
\nDay 81, 3/11 no change: LB 0.815 Public: 0.812 (Dream teamed formed - Senkin13&\"tmp\", top boosting and top NN joined together, any one can beat them ?)
\n(By the way - at the early days of the competition in was written here - look on \"tmp's\"' solution and github:
\n(https://www.kaggle.com/competitions/lish-moa/discussion/202256). It is not too late even now ).
\nDay 80, 2/11 no change: LB 0.815 Public: 0.812 (The first time top1 changed - \"tmp\" 0.815 E39, senkin13 is now top2 0.815 E64)
\nDay 79, 1/11 no change: LB 0.815 Public: 0.812 (\"tmp\" is the second to break 0.815, 18 teams above 0.814, )
\nDay 78, 31/10 no change: LB 0.815 Public: 0.812
\nDay 77, 30/10 no change: LB 0.815 Public: 0.812
\nDay 76, 29/10 no change: LB 0.815 Public: 0.812
\nDay 75, 28/10 no change: LB 0.815 Public: 0.812
\nDay 74, 27/10 no change: LB 0.815 Public: 0.812
\nDay 73, 26/10 no change: LB 0.815 Public: 0.812
\nDay 72, 25/10 no change: LB 0.815 Public: 0.812
\nDay 71, 24/10 no change: LB 0.815 Public: 0.812 (6 teams above 0.814)
\nDay 70, 23/10 no change: LB 0.815 Public: 0.812 (5 teams above 0.814)
\nDay 69, 22/10 no change: LB 0.815 Public: 0.812
\nDay 68, 21/10 no change: LB 0.815 Public: 0.812
\nDay 67, 20/10 no change: LB 0.815 Public: 0.812 , 4-th team achieved 0.814 on LB - \"
\nHow to predict Citeseq\" (user: \"A Beginner\") E238 - Position 4.
\nDay 66, 19/10 !!! Breakthrough LB 0.815 - Senkin13 E55 Public: 0.812 (After 30 days of 0.814 on LB and release of the new data - finally 0.815)
\nDay 65, 18/10 LB 0.814 Public increase: 0.812; The third team achieved 0.814 on LB - \"Protein Shake\" E124. Public 0.812: ( MEHRAN KAZEMINIA Blend achieved 0.812) and another: 0.812 LAURENT POURCHOT
\nDay 64, 17/10 no change: LB 0.814 Public: 0.811
\nDay 63, 16/10 no change: LB 0.814 Public: 0.811
\nDay 62, 15/10 no change: LB 0.814 Public: 0.811
\nDay 61, 14/10 LB 0.814 (Senkin13 E48 - no change) ; small change for public top: : 0.811 (New top public: 0.811+ JUAN SMITH PERERA Adding to the Keras model a grouping based on donor x days. .
\nThe second team reached 0.814: definitelynot KhaVo+MT
\nDay 60, 13/10 no change: LB 0.814 Public: 0.811
\nDay 59, 12/10 no change: LB 0.814 Public: 0.811 . New data has been issued.
\nDay 58, 11/10 no change: LB 0.814 Public: 0.811
\nDay 57, 10/10 no change: LB 0.814 Public: 0.811
\nDay 56, 9/10 no change: LB 0.814 Public: 0.811
\nDay 55, 8/10 no change: LB 0.814 Public: 0.811
\nDay 54, 7/10 no change: LB 0.814 Public: 0.811
\nDay 53, 6/10 no change: LB 0.814 Public: 0.811
\nDay 52, 5/10 no change: LB 0.814 Public: 0.811
\nDay 51, 4/10 no change: LB 0.814 Public: 0.811
\nDay 50, 3/10 no change: LB 0.814 Public: 0.811
\nDay 49, 2/10 no change: LB 0.814 Public: 0.811
\nDay 47, 1/10 no change: LB 0.814 Public: 0.811
\nDay 46, 30/09 no change: LB 0.814 Public: 0.811
\nDay 45, 29/09 no change: LB 0.814 Public: 0.811
\nDay 44, 28/09 no change: LB 0.814 Public: 0.811
\nDay 43, 27/09 no change: LB 0.814 Public: 0.811
\nDay 42, 26/09 no change: LB 0.814 Public: 0.811
\nDay 41, 25/09 no change: LB 0.814 Public: 0.811 ( MT E81 and AmbrosM achieved 0.812 E38 - Top2 and Top4)
\nDay 40, 24/09 no change: LB 0.814 Public: 0.811
\nDay 39, 23/09 no change: LB 0.814 Public: 0.811
\nDay 38, 22/09 no change: LB 0.814 Public: 0.811
\nDay 37, 21/09 no change: LB 0.814 Public: 0.811 (Magnus achieved 0.812 = Top3)
\nDay 36, 20/09 no change: LB 0.814 Public: 0.811
\nDay 35, 19/09 !!! Breakthrough LB 0.814 !!!LB 0.814 (Finally senkin13 achieved 0.814 E27) Public: 0.811
\nDay 34, 18/09 LB 0.813+ Public: 0.811 (new , a little better score, but less blend - Keras + Catboost + some blend)
\nDay 33, 17/09 no change: LB 0.813 Public: 0.811
\nDay 32, 16/09 no change: LB 0.813 Public: 0.811
\nDay 31, 15/09 no change: LB 0.813 Public: 0.811 (Silogram achieved 0.813 E41 , and became N2)
\nDay 30, 14/09 no change: LB 0.813 Public: 0.811
\nDay 29, 13/09 no change: LB 0.813 Public: 0.811
\nDay 28, 12/09 no change: LB 0.813 Public: 0.811
\nDay 27, 11/09 no change: LB 0.813 Public: 0.811
\nDay 26, 10/09 no change: LB 0.813 Public: 0.811
\nDay 25, 09/09 Rescoring process finished (hopefully). The top of LB is basically the same: senkin13: 0.813
\n15, Btbpanda 0.812 25, Mustafa Keser 0.812 79, Silogram 0.812 39. About 0.048 below the old one. Top public: 0.811
\nDay 24, 08/09 Rescoring process not finished yet (restarted)
\nDay 23, 07/09 Data Update and Rescore - exclude data leak. SCORES CHANGE approximately by 0.048 down
\nDay 22, 06/09 LB 0.860 (Btbpanda E25). Public: 0.858 Several. (S: 0.860 35, AC: 0.858 43, AV 0.860 25 S13 0.859 11)
\nDay 21, 05/09 LB 0.860 (Btbpanda E24). Public: 0.858 Several. (S: 0.859 32, AC: 0.858 42, AV 0.860 24 S13 0.859 11)
\nDay 20, 04/09 LB 0.860 (Mustafa Keser E54). Public: 0.858 CITEseq Keras (AMBROSM) (S: 0.859 27, AC: 0.857 36, AV 0.859 22 S13 0.859 8)
\nDay 19, 03/09 LB 0.859 (Btbpanda, E19). Public: 0.853 AMBROSM. Some scores S 0.859, 27, AC 0.855 31, S13 0.854 4
\nDay 18, 02/09 LB Same. Public: 0.848 (Similar to previous top public ) (J. S. Perera). Some scores S: 0.856, 22, AC: 0.850 27
\n Day 17, 01/09 NO change. Some scores S: 0.848 17, AC: 0.849 24
\nDay 16, 31/08 LB: 0.858 (minhtu.mt.mt, E30), Public: 0.847 (PCA+RIDGE on Multiome made Sparse) FABIEN CROM
\nDay 15, 30/08 LB: 0.855 (Jie Wu, E27), same: Public: same : 0.834 (LGBM+Optuna+Drop Const)
\nDay 14, 29/08 same: LB: 0.854 (E25), same: Public: same : 0.834 (LGBM+Optuna+Drop Const)
\nDay 13, 28/08 LB: 0.854 (E25), Public: same : 0.834 (LGBM+Optuna+Drop Const)
\nDay 12, 27/08 LB: 0.848 (E12), Public: 0.834 (LGBM+Optuna+Drop Const)

\n\n

==

\n", "rawMarkdown": "Welcome to add your findings in comments here.\n\nThat is was great and hard competition ! Thanks to organizers and congratulations to everybody who gained prizes/medals/experience/fun... ! \n\n**Day 93 15/11** no change: LB 0.816 Public: 0.812 - the last day of the competition\n**Day 92 14/11** no change: LB 0.816 Public: 0.812 (Incredible fighting top2-10 LB is changing very fast. 9 teams above 0.815, 45 teams above 0.814)\n**Day 91, 13/11** no change: LB 0.816 Public: 0.812 (The fight is very tough top2-5 positions are quite interchanging,\nsubmissions can be seen every hour. 7 teams above 0.815. 30 teams above 0.814. The poll for shake-up reveals some fears: https://t.me/sberlogacompete/3232 )\n**Day 90, 12/11** no change: LB 0.816 Public: 0.812 \n(The fight for the top2-3 places is very tough - positions were changed several times per day;\nTeams: [Kha|MT|B|Ambros], [Risk-ZaloPay] Aggressive, [Protein Shake]. 5 Teams above 0.815, 23 teams above 0.814 )\n**Day 88, 10/11** no change: LB 0.815 Public: 0.812\n**Day 87, 9/11** **!!! Breakthrough LB 0.816 !!!** Public: 0.812 (Senkin&tmp break 0.816. Fourth team achieve 0.815 \"Protein Shake\" E191, 21 team above 0.814 )\n**Day 86, 8/11** no change: LB 0.815 Public: 0.812\n**Day 85, 7/11** no change: LB 0.815 Public: 0.812\n**Day 84, 6/11** no change: LB 0.815 Public: 0.812+ ([New top public blend appeared](https://www.kaggle.com/code/liullllll/5-5-msci22-ensembling-citeseq), but still 0.812. Above 0.814 - 19 teams) \n**Day 83, 5/11** no change: LB 0.815 Public: 0.812 (Third team break 0.815 - Kha | MT | B | Ambros E268)\n**Day 82, 4/11** no change: LB 0.815 Public: 0.812\n**Day 81, 3/11** no change: LB 0.815 Public: 0.812 (Dream teamed formed - Senkin13&\"tmp\", top boosting and top NN joined together, any one can beat them ?)\n(By the way - at the early days of the competition in was written here - look on \"tmp's\"' solution and github: \n(https://www.kaggle.com/competitions/lish-moa/discussion/202256). It is not too late even now ).\n**Day 80, 2/11** no change: LB 0.815 Public: 0.812 (The first time top1 changed - \"tmp\" 0.815 E39, senkin13 is now top2 0.815 E64) \n**Day 79, 1/11** no change: LB 0.815 Public: 0.812 (\"tmp\" is the second to break 0.815, 18 teams above 0.814, )\n**Day 78, 31/10** no change: LB 0.815 Public: 0.812\n**Day 77, 30/10** no change: LB 0.815 Public: 0.812\n**Day 76, 29/10** no change: LB 0.815 Public: 0.812\n**Day 75, 28/10** no change: LB 0.815 Public: 0.812\n**Day 74, 27/10** no change: LB 0.815 Public: 0.812\n**Day 73, 26/10** no change: LB 0.815 Public: 0.812\n**Day 72, 25/10** no change: LB 0.815 Public: 0.812\n**Day 71, 24/10** no change: LB 0.815 Public: 0.812 (6 teams above 0.814)\n**Day 70, 23/10** no change: LB 0.815 Public: 0.812 (5 teams above 0.814)\n**Day 69, 22/10** no change: LB 0.815 Public: 0.812\n**Day 68, 21/10** no change: LB 0.815 Public: 0.812\n**Day 67, 20/10** no change: LB 0.815 Public: 0.812 , 4-th team achieved 0.814 on LB - \"\nHow to predict Citeseq\" (user: \"A Beginner\") E238 - Position 4. \n**Day 66, 19/10** **!!! Breakthrough LB 0.815** - Senkin13 E55 Public: 0.812 (After 30 days of 0.814 on LB and release of the new data - finally 0.815) \n**Day 65, 18/10** LB 0.814 Public increase: 0.812; The third team achieved 0.814 on LB - \"Protein Shake\" E124. Public 0.812: ( MEHRAN KAZEMINIA [Blend achieved 0.812](https://www.kaggle.com/code/mehrankazeminia/5-5-msci22-ensembling-citeseq)) and another: [0.812 LAURENT POURCHOT](https://www.kaggle.com/code/pourchot/all-in-one-citeseq-multiome-with-keras)\n**Day 64, 17/10** no change: LB 0.814 Public: 0.811 \n**Day 63, 16/10** no change: LB 0.814 Public: 0.811 \n**Day 62, 15/10** no change: LB 0.814 Public: 0.811 \n**Day 61, 14/10** LB 0.814 (Senkin13 E48 - no change) ; small change for public top: : 0.811 (New top public: [0.811+ JUAN SMITH PERERA Adding to the Keras model a grouping based on donor x days. ](https://www.kaggle.com/code/jsmithperera/citeseq-keras-multiome-5x5).\nThe second team reached 0.814: definitelynot KhaVo+MT\n**Day 60, 13/10** no change: LB 0.814 Public: 0.811 \n**Day 59, 12/10** no change: LB 0.814 Public: 0.811 . [New data has been issued. ](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/359355) \n**Day 58, 11/10** no change: LB 0.814 Public: 0.811 \n**Day 57, 10/10** no change: LB 0.814 Public: 0.811 \n**Day 56, 9/10** no change: LB 0.814 Public: 0.811 \n**Day 55, 8/10** no change: LB 0.814 Public: 0.811 \n**Day 54, 7/10** no change: LB 0.814 Public: 0.811 \n**Day 53, 6/10** no change: LB 0.814 Public: 0.811 \n**Day 52, 5/10** no change: LB 0.814 Public: 0.811 \n**Day 51, 4/10** no change: LB 0.814 Public: 0.811 \n**Day 50, 3/10** no change: LB 0.814 Public: 0.811 \n**Day 49, 2/10** no change: LB 0.814 Public: 0.811 \n**Day 47, 1/10** no change: LB 0.814 Public: 0.811 \n**Day 46, 30/09** no change: LB 0.814 Public: 0.811 \n**Day 45, 29/09** no change: LB 0.814 Public: 0.811 \n**Day 44, 28/09** no change: LB 0.814 Public: 0.811 \n**Day 43, 27/09** no change: LB 0.814 Public: 0.811 \n**Day 42, 26/09** no change: LB 0.814 Public: 0.811 \n**Day 41, 25/09** no change: LB 0.814 Public: 0.811 ( MT E81 and AmbrosM achieved 0.812 E38 - Top2 and Top4) \n**Day 40, 24/09** no change: LB 0.814 Public: 0.811 \n**Day 39, 23/09** no change: LB 0.814 Public: 0.811 \n**Day 38, 22/09** no change: LB 0.814 Public: 0.811 \n**Day 37, 21/09** no change: LB 0.814 Public: 0.811 (Magnus achieved 0.812 = Top3) \n**Day 36, 20/09** no change: LB 0.814 Public: 0.811 \n**Day 35, 19/09** **!!! Breakthrough LB 0.814 !!!**LB 0.814 (Finally senkin13 achieved 0.814 E27) Public: 0.811 \n**Day 34, 18/09** LB 0.813+ Public: 0.811 (new , a little better score, but less blend - [Keras + Catboost + some blend](https://www.kaggle.com/code/pourchot/multiome-with-keras-ensemble))\n**Day 33, 17/09** no change: LB 0.813 Public: 0.811\n**Day 32, 16/09** no change: LB 0.813 Public: 0.811\n**Day 31, 15/09** no change: LB 0.813 Public: 0.811 (Silogram achieved 0.813 E41 , and became N2) \n**Day 30, 14/09** no change: LB 0.813 Public: 0.811\n**Day 29, 13/09** no change: LB 0.813 Public: 0.811\n**Day 28, 12/09** no change: LB 0.813 Public: 0.811\n**Day 27, 11/09** no change: LB 0.813 Public: 0.811\n**Day 26, 10/09** no change: LB 0.813 Public: 0.811\n**Day 25, 09/09** Rescoring process finished (hopefully). The top of LB is basically the same: senkin13: 0.813\n15, Btbpanda 0.812 25, Mustafa Keser 0.812 79, Silogram 0.812 39. About 0.048 below the old one. [Top public: 0.811](https://www.kaggle.com/code/vslaykovsky/lb-0-811-normalized-ensembles-for-pearson-s-r/notebook?scriptVersionId=105258966) \n**Day 24, 08/09** Rescoring process not finished yet (restarted)\n**Day 23, 07/09** **[Data Update and Rescore - exclude data leak](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/350933). SCORES CHANGE approximately by 0.048 down**\n**Day 22, 06/09** LB 0.860 (Btbpanda E25). Public: 0.858 Several. (S: 0.860 35, AC: 0.858 43, AV 0.860 25 S13 0.859 11)\n**Day 21, 05/09** LB 0.860 (Btbpanda E24). Public: 0.858 Several. (S: 0.859 32, AC: 0.858 42, AV 0.860 24 S13 0.859 11)\n**Day 20, 04/09** LB 0.860 (Mustafa Keser E54). Public: 0.858 [CITEseq Keras] (https://www.kaggle.com/code/ambrosm/msci-citeseq-keras-quickstart) (AMBROSM) (S: 0.859 27, AC: 0.857 36, AV 0.859 22 S13 0.859 8)\n**Day 19, 03/09** LB 0.859 (Btbpanda, E19). Public: 0.853 [AMBROSM](https://www.kaggle.com/code/ambrosm/msci-citeseq-quickstart). Some scores S 0.859, 27, AC 0.855 31, S13 0.854 4\n**Day 18, 02/09** LB Same. Public: 0.848 ([Similar to previous top public ](https://www.kaggle.com/code/jsmithperera/multiome-quickstart-w-sparse-m-tsvd-32)) (J. S. Perera). Some scores S: 0.856, 22, AC: 0.850 27\n **Day 17, 01/09** NO change. Some scores S: 0.848 17, AC: 0.849 24 \n**Day 16, 31/08** LB: 0.858 (minhtu.mt.mt, E30), Public: 0.847 [(PCA+RIDGE on Multiome made Sparse)](https://www.kaggle.com/code/fabiencrom/msci-multiome-quickstart-w-sparse-matrices) FABIEN CROM\n**Day 15, 30/08** LB: 0.855 (Jie Wu, E27), same: Public: same : 0.834 (LGBM+Optuna+Drop Const)\n**Day 14, 29/08** same: LB: 0.854 (E25), same: Public: same : 0.834 (LGBM+Optuna+Drop Const)\n**Day 13, 28/08** LB: 0.854 (E25), Public: same : 0.834 (LGBM+Optuna+Drop Const)\n**Day 12, 27/08** LB: 0.848 (E12), Public: 0.834 (LGBM+Optuna+Drop Const)\n\n- **New data**\n-- [New data has been issued. ](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/359355)\n\n==\n\n- **Feature Engineering**\n-- [Feature shop for you - lots of engineered features by dimensional reduction and clustering](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/359683)\n-- Similar for Multiome - https://www.kaggle.com/datasets/stasborodynkin/feature-shop-for-mmscel-multiome\n- **Publics:** \n-- 06 11 2002: [New top public blend appeared](https://www.kaggle.com/code/liullllll/5-5-msci22-ensembling-citeseq), but still 0.812\n-- [Useful discussion on models, MLP, Keras-NN, Catboost](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/359866)\n-- [0.812MEHRAN KAZEMINIA ](https://www.kaggle.com/code/mehrankazeminia/5-5-msci22-ensembling-citeseq)\n-- [0.812 LAURENT POURCHOT](https://www.kaggle.com/code/pourchot/all-in-one-citeseq-multiome-with-keras)\n-- [0.811+ JUAN SMITH PERERA Adding to the Keras model a grouping based on donor x days. ](https://www.kaggle.com/code/jsmithperera/citeseq-keras-multiome-5x5)\n-- [0.811+ LAURENT POURCHOT Keras + Catboost + some blend](https://www.kaggle.com/code/pourchot/multiome-with-keras-ensemble)\n-- [0.811 JOSE CARMONA idea - be careful with blend - look separately Multiome and CITEseq](https://www.kaggle.com/code/josecarmona/msci22-keep-in-mind-2in1/notebook?scriptVersionId=105880791) \n-- [0.811 VLADIMIR SLAYKOVSKIY Normalized Ensembles ](https://www.kaggle.com/code/vslaykovsky/lb-0-811-normalized-ensembles-for-pearson-s-r/notebook?scriptVersionId=105258966) \n-- 0.81 [Citeseq: TrancSVD->Keras Dense 4Layers with Dropout (with tune params by KerasTuner); Multiome: CatBoost by XiaFire](https://www.kaggle.com/code/sskknt/msci-citeseq-keras-quickstart-dropout/notebook?scriptVersionId=105219293)\n-- 0.81 [CATboost-regressor Multiome](https://www.kaggle.com/code/xiafire/lb-t15-msci-multiome-catboostregressor)\n-- 0.807 [TabNet on CITEseq ; on Multiome not the best solution](https://www.kaggle.com/code/tamaryo/lb-0-805-citeseq-tabnet-baseline)\n-- (0.858old) [CITEseq Keras](https://www.kaggle.com/code/ambrosm/msci-citeseq-keras-quickstart) (AMBROSM)\n-- 0.803 (0.853old) [AMBROSM](https://www.kaggle.com/code/ambrosm/msci-citeseq-quickstart) - merge LGBM on CITEseq with PCA+RIDGE on Multiome \n-- (0.848old) ([Similar to previous top public ](https://www.kaggle.com/code/jsmithperera/multiome-quickstart-w-sparse-m-tsvd-32)) (J. S. Perera).\n-- 0.803 (0.847old) [(PCA+RIDGE on Multiome made Sparse)](https://www.kaggle.com/code/fabiencrom/msci-multiome-quickstart-w-sparse-matrices) FABIEN CROM\n-- 0.794 (0.83, 0834old) - [LGBM+Optuna on CiteSeq](https://www.kaggle.com/code/vuonglam/lgbm-baseline-optuna-drop-constant-cite-task)\n-- 0.792 [ SWIMMY【LGBM Baseline】MSCI CITEseq]( https://www.kaggle.com/code/swimmy/lgbm-baseline-msci-citeseq)\n-- (0.824old) - [LGBM on CiteSeq](https://www.kaggle.com/code/ambrosm/msci-citeseq-quickstart)\n-- (0.814old) - [PCA+Ridge on CiteSeq](https://www.kaggle.com/code/ambrosm/msci-citeseq-quickstart)\n-- (0.741old) - [Just averages](https://www.kaggle.com/code/shuntarotanaka/simple-submission-average-by-gene-id)\n- **Postprocessing:**\n-- [Normalize to 1e6 etc](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/349132) \n- **Data Tricks:**\n-- Conversion to sparse of multiome data - now it fits kaggle RAM ([Notebook](https://www.kaggle.com/code/sbunzini/reduce-memory-usage-by-95-with-sparse-matrices))\n- **Technology:**\n-- Saturn cloud with big RAM is accessible\n- **Problems:** \n-- [Newly provided \"test\" file contain more features](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/350933#1931702) and see [also](https://www.kaggle.com/code/erivanoliveirajr/multimodal-single-cell-integration/data)\n-- [Data Lick found (resolved 23-25.09)](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/347890)\n-- [Shake-up inevitable](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/347202)\n- **Related research**\n-- [Collection of links to papers, videos, etc ](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/351038)\n- **Strange things:** \n-- Negative values in protein measurements. Organizers: [\"I agree this is weird! \" ](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/346210)\n- **Soft Questions:** \n-- Why just average solution gives such high score ? Seems answer - variation of targets around mean is not big, mean is easily predictable \n- **Suggestions:** \n-- It is multitarget, so we need neural networks, might look at MoA examples e.g. nice [top2](https://www.kaggle.com/competitions/lish-moa/discussion/202256): \n- **Events:** \n-- Introductory lectures related to Kaggle and Biology are planned: see https://www.kaggle.com/competitions/open-problems-multimodal/discussion/348661\n- **Biology:** \n-- Super cool ! [Donors - 3 men and 1 woman](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/348761) (by Y chromosome in ATAC-seq data) \n-- [Nice UMAP](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/348117) figures, day 3|HSC - outlier. Why ? What is going on ? Differentiation ? But why it disappears on day 4 ? Something unclear is here\n-- [Details on biological processing](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/348761)\n-- [Cell proliferation cycle analysis](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/350314)\n-- [Analysis of correlations and some findings](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/351725)\n-- Seems ATAC-seq it is not really changing [Heatmap of ATAC-seq](https://www.kaggle.com/code/norifumiirie/heatmap-of-multiome-data?scriptVersionId=105460251&cellId=30) and same [by chromosome](https://www.kaggle.com/alexandervc/heatmap-of-atac-seq-multiome-data)\n\n \n ", "votes": 51 }, { "id": 2032072, "postDate": "2022-11-16T12:08:37.253Z", "content": "

Thanks for your effort for this competition, your thread is always interesting and informative.

", "rawMarkdown": "Thanks for your effort for this competition, your thread is always interesting and informative.", "votes": 3 }, { "id": 2029780, "postDate": "2022-11-14T22:42:28.113Z", "content": "

Day 92 14/11 no change: LB 0.816 Public: 0.812 (Incredible fighting top2-10 LB is changing very fast. 9 teams above 0.815, 45 teams above 0.814)

\n

LB is changing so fast:

\n

\"\"

", "rawMarkdown": "**Day 92 14/11** no change: LB 0.816 Public: 0.812 (Incredible fighting top2-10 LB is changing very fast. 9 teams above 0.815, 45 teams above 0.814)\n\nLB is changing so fast:\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2Fc7b8792c2af75221844395388e01e544%2FScreenshot%202022-11-14%20234150.png?generation=1668465729638918&alt=media)", "votes": 1 }, { "id": 2028425, "postDate": "2022-11-13T22:37:50.427Z", "content": "

Day 91, 13/11 no change: LB 0.816 Public: 0.812
\n (The fight is very tough - top2-5 positions are quite interchanging,
\nsubmissions can be seen every hour. 7 teams above 0.815. 30 teams above 0.814. The poll for shake-up reveals some fears: https://t.me/sberlogacompete/3232 )
\n\"\"

", "rawMarkdown": "**Day 91, 13/11 no change: LB 0.816 Public: 0.812**\n (The fight is very tough - top2-5 positions are quite interchanging,\nsubmissions can be seen every hour. 7 teams above 0.815. 30 teams above 0.814. The poll for shake-up reveals some fears: https://t.me/sberlogacompete/3232 )\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2F6ca1402184667582da6e31ab1e866549%2FScreenshot%202022-11-13%20233712.png?generation=1668379062800764&alt=media)", "votes": 1 }, { "id": 2023366, "postDate": "2022-11-09T17:48:21.750Z", "content": "

Day 87, 9/11 !!! Breakthrough LB 0.816 !!! Public: 0.812 (Senkin&tmp break 0.816. Fourth team achieve 0.815 \"Protein Shake\" E191, 21 team above 0.814 )

\n

\"\"

", "rawMarkdown": "**Day 87, 9/11 !!! Breakthrough LB 0.816 !!!** Public: 0.812 (Senkin&tmp break 0.816. Fourth team achieve 0.815 \"Protein Shake\" E191, 21 team above 0.814 )\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2F607b277430115f1a54251a3ef63e1b4f%2FScreenshot%202022-11-09%20184744.png?generation=1668016075717636&alt=media)", "votes": 1 }, { "id": 2019653, "postDate": "2022-11-06T19:50:23.687Z", "content": "

Day 84, 6/11 no change: LB 0.815 Public: 0.812+ (New top public blend appeared, but still 0.812. Above 0.814 - 19 teams)
\nDay 83, 5/11 no change: LB 0.815 Public: 0.812 (Third team break 0.815 - Kha | MT | B | Ambros E268)

\n

\"\"

", "rawMarkdown": "**Day 84, 6/11** no change: LB 0.815 Public: 0.812+ ([New top public blend appeared](https://www.kaggle.com/code/liullllll/5-5-msci22-ensembling-citeseq), but still 0.812. Above 0.814 - 19 teams) \n**Day 83, 5/11** no change: LB 0.815 Public: 0.812 (Third team break 0.815 - Kha | MT | B | Ambros E268)\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2F3796167a1e14bb819235e4ce179b78be%2FScreenshot%202022-11-06%20204013.png?generation=1667764190148097&alt=media)", "votes": 1 }, { "id": 2014282, "postDate": "2022-11-02T13:38:03.733Z", "content": "

Day 80, 2/11 no change: LB 0.815 Public: 0.812 (The first time top1 changed \"tmp\" 0.815 E39, senkin13 is now top2 0.815 E64)
\nDay 79, 1/11 no change: LB 0.815 Public: 0.812 (\"tmp\" is the second to break 0.815, 18 teams above 0.814, )

\n

\"\"

", "rawMarkdown": "**Day 80, 2/11** no change: LB 0.815 Public: 0.812 (The first time top1 changed \"tmp\" 0.815 E39, senkin13 is now top2 0.815 E64) \n**Day 79, 1/11** no change: LB 0.815 Public: 0.812 (\"tmp\" is the second to break 0.815, 18 teams above 0.814, )\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2Fa587dbbc099b34d2a35b8060e7f2ec14%2FScreenshot%202022-11-02%20143707.png?generation=1667396277264497&alt=media)", "votes": 1 }, { "id": 2001765, "postDate": "2022-10-24T09:48:37.560Z", "content": "

Day 70, 23/10 no change: LB 0.815 Public: 0.812 (5 teams above 0.814)
\n\"\"

", "rawMarkdown": "**Day 70, 23/10** no change: LB 0.815 Public: 0.812 (5 teams above 0.814)\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2Fb222f0c2313434240f6e6b756c220ac8%2FScreenshot%202022-10-23%20212045.png?generation=1666604614764911&alt=media)", "votes": 1, "replies": [ { "id": 2001786, "postDate": "2022-10-24T09:59:51.440Z", "content": "

Senkin hopes to beat .815 limit
\n\"\"

", "rawMarkdown": "Senkin hopes to beat .815 limit \n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3913785%2Fc50272781ddac058b8db190afba365c6%2FIMG_20221024_115419.jpg?generation=1666605321518246&alt=media)", "votes": 3 } ] }, { "id": 1979933, "postDate": "2022-10-09T20:25:31.010Z", "content": "

Day 56, 9/10 no change: LB 0.814 Public: 0.811

\n

\"\"

", "rawMarkdown": "**Day 56, 9/10** no change: LB 0.814 Public: 0.811 \n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2F13f1d3ebda3c48b93b2a360fb3c192e4%2FScreenshot%202022-10-09%20222219.png?generation=1665347026223790&alt=media)", "votes": 1 }, { "id": 1957893, "postDate": "2022-09-27T07:41:42.060Z", "content": "

Percent of HSC cells decrease daily,
\nit might be \"differentiation\" (i.e. transformation to other cell types) or just worse survival.

\n

Probably for day 10, it will be even less HSC.
\nThus if models depend on types - we need to take that into account.

\n

https://www.kaggle.com/code/ryumei1987/msci-eda?scriptVersionId=106560721&cellId=9
\n\"\"

", "rawMarkdown": "Percent of HSC cells decrease daily,\nit might be \"differentiation\" (i.e. transformation to other cell types) or just worse survival.\n\nProbably for day 10, it will be even less HSC.\nThus if models depend on types - we need to take that into account. \n\nhttps://www.kaggle.com/code/ryumei1987/msci-eda?scriptVersionId=106560721&cellId=9\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2F5139dd2094f420998486efd6056cedf5%2FScreenshot%202022-09-27%20093943.png?generation=1664264395840435&alt=media)", "votes": 1 }, { "id": 1955133, "postDate": "2022-09-25T18:29:02.313Z", "content": "

Day 41, 25/09 no change: LB 0.814 Public: 0.811 ( MT E81 and AmbrosM achieved 0.812 E38 - Top2 and Top4)

\n

\"\"

", "rawMarkdown": "**Day 41, 25/09** no change: LB 0.814 Public: 0.811 ( MT E81 and AmbrosM achieved 0.812 E38 - Top2 and Top4)\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2F4f13f9ee8d0d93cb7e6654d6358136e5%2FScreenshot%202022-09-25%20202808.png?generation=1664130537597986&alt=media)\n", "votes": 1, "replies": [ { "id": 1955595, "postDate": "2022-09-26T04:22:39.170Z", "content": "

I wander what makes so many people achieved 813 just one day

", "rawMarkdown": "I wander what makes so many people achieved 813 just one day", "votes": 2 }, { "id": 1956151, "postDate": "2022-09-26T10:01:54.540Z", "content": "

I guess it is Sunday. People have free time for Kaggle. Not sure I am right. Just hypothesis

", "rawMarkdown": "I guess it is Sunday. People have free time for Kaggle. Not sure I am right. Just hypothesis ", "votes": 1 }, { "id": 1968022, "postDate": "2022-10-02T20:10:26.257Z", "content": "

Day 48, 2/10 no change: LB 0.814 Public: 0.811

\n

\"\"

", "rawMarkdown": "**Day 48, 2/10** no change: LB 0.814 Public: 0.811 \n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2Fa4d4a517fd195cb8e34388b8e94bc37a%2FScreenshot%202022-10-02%20220917.png?generation=1664741376682003&alt=media)", "votes": 1 } ] }, { "id": 1947412, "postDate": "2022-09-20T12:57:00.453Z", "content": "

Hi Alexander:

\n

Great work and very useful!

\n

Thanks for sharing

", "rawMarkdown": "Hi Alexander:\n\nGreat work and very useful!\n\nThanks for sharing", "votes": 1 }, { "id": 2031183, "postDate": "2022-11-15T23:19:17.987Z", "content": "

Hi @alexandervc,

\n

Thank for this great thread. It was very useful to me and was a perfect daily report about the competition status. I hope you be luck in the final ranking

", "rawMarkdown": "Hi @alexandervc,\n\nThank for this great thread. It was very useful to me and was a perfect daily report about the competition status. I hope you be luck in the final ranking", "votes": 2 }, { "id": 1988157, "postDate": "2022-10-15T05:43:28.937Z", "content": "

Pay attention - new data has been issued - raw counts:

\n

https://www.kaggle.com/competitions/open-problems-multimodal/discussion/359355

\n

Day 61, 14/10 LB 0.814 Public: 0.811 (New top public: 0.811+ JUAN SMITH PERERA Adding to the Keras model a grouping based on donor x days. .

\n

Congratulations to the second team reaching 0.814:

\n

definitelynot KhaVo+MT

\n

\"\"

", "rawMarkdown": "## Pay attention - new data has been issued - raw counts:\nhttps://www.kaggle.com/competitions/open-problems-multimodal/discussion/359355\n\n**Day 61, 14/10** LB 0.814 Public: 0.811 (New top public: 0.811+ JUAN SMITH PERERA Adding to the Keras model a grouping based on donor x days. .\n\n### Congratulations to the second team reaching 0.814:\ndefinitelynot KhaVo+MT\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2F0aae3156cce1353dddf8e535c3fb8568%2FScreenshot%202022-10-15%20074258.png?generation=1665812596198739&alt=media)\n", "votes": 2 }, { "id": 1979954, "postDate": "2022-10-09T20:52:05.610Z", "content": "

It seems that we are blocked

", "rawMarkdown": "It seems that we are blocked", "votes": 2 }, { "id": 1955245, "postDate": "2022-09-25T21:22:09.527Z", "content": "

That might be useful:
\n1) https://www.kaggle.com/code/konomuabe/average-of-gene-id-and-day
\n\"Simple Submission - Average by gene_id scored 0.741 This note book calculates average of gene_id grouped by the day. But the score is 0.748.
\nDay may not affect the results much.
\nLooking at CV, citeseq improves 0.0035 and multiome improves 0.0068 in correlation if days are taken into account.
\n\"
\nRemark: 0.741 - the scores BEFORE leak correction - now one should substruct about 0.048.
\nThe pure average now gives 0.718 - see - https://www.kaggle.com/code/shuntarotanaka/simple-submission-average-by-gene-id

\n

2)
\nAverages with respect to cell type give: 0.760 ! (Improvement from 0.718 for simple averages )
\nSee https://www.kaggle.com/code/norifumiirie/simple-submission-mean-by-gene-id-and-cell-type?scriptVersionId=106556768

", "rawMarkdown": "That might be useful: \n1) https://www.kaggle.com/code/konomuabe/average-of-gene-id-and-day\n\"Simple Submission - Average by gene_id scored 0.741 This note book calculates average of gene_id grouped by the day. But the score is 0.748. \nDay may not affect the results much.\nLooking at CV, citeseq improves 0.0035 and multiome improves 0.0068 in correlation if days are taken into account.\n\"\nRemark: 0.741 - the scores BEFORE leak correction - now one should substruct about 0.048. \nThe pure average now gives 0.718 - see - https://www.kaggle.com/code/shuntarotanaka/simple-submission-average-by-gene-id\n\n2) \nAverages with respect to cell type give: 0.760 ! (Improvement from 0.718 for simple averages )\nSee https://www.kaggle.com/code/norifumiirie/simple-submission-mean-by-gene-id-and-cell-type?scriptVersionId=106556768 \n\n\n\n", "votes": 2 }, { "id": 1937997, "postDate": "2022-09-13T19:57:21.767Z", "rawMarkdown": "", "isDeleted": true }, { "id": 2029159, "postDate": "2022-11-14T13:47:18.097Z", "content": "

Wow, thank you this is great!!

", "rawMarkdown": "Wow, thank you this is great!!", "votes": 2 } ], "comments": [ { "id": 2032072, "author_name": "senkin13", "author_url": "", "post_date": "2022-11-16T12:08:37.253000", "content": "

Thanks for your effort for this competition, your thread is always interesting and informative.

", "votes": 3, "replies": [] }, { "id": 2029780, "author_name": "Alexander Chervov", "author_url": "", "post_date": "2022-11-14T22:42:28.113000", "content": "

Day 92 14/11 no change: LB 0.816 Public: 0.812 (Incredible fighting top2-10 LB is changing very fast. 9 teams above 0.815, 45 teams above 0.814)

\n

LB is changing so fast:

\n

\"\"

", "votes": 1, "replies": [] }, { "id": 2028425, "author_name": "Alexander Chervov", "author_url": "", "post_date": "2022-11-13T22:37:50.427000", "content": "

Day 91, 13/11 no change: LB 0.816 Public: 0.812
\n (The fight is very tough - top2-5 positions are quite interchanging,
\nsubmissions can be seen every hour. 7 teams above 0.815. 30 teams above 0.814. The poll for shake-up reveals some fears: https://t.me/sberlogacompete/3232 )
\n\"\"

", "votes": 1, "replies": [] }, { "id": 2023366, "author_name": "Alexander Chervov", "author_url": "", "post_date": "2022-11-09T17:48:21.750000", "content": "

Day 87, 9/11 !!! Breakthrough LB 0.816 !!! Public: 0.812 (Senkin&tmp break 0.816. Fourth team achieve 0.815 \"Protein Shake\" E191, 21 team above 0.814 )

\n

\"\"

", "votes": 1, "replies": [] }, { "id": 2019653, "author_name": "Alexander Chervov", "author_url": "", "post_date": "2022-11-06T19:50:23.687000", "content": "

Day 84, 6/11 no change: LB 0.815 Public: 0.812+ (New top public blend appeared, but still 0.812. Above 0.814 - 19 teams)
\nDay 83, 5/11 no change: LB 0.815 Public: 0.812 (Third team break 0.815 - Kha | MT | B | Ambros E268)

\n

\"\"

", "votes": 1, "replies": [] }, { "id": 2014282, "author_name": "Alexander Chervov", "author_url": "", "post_date": "2022-11-02T13:38:03.733000", "content": "

Day 80, 2/11 no change: LB 0.815 Public: 0.812 (The first time top1 changed \"tmp\" 0.815 E39, senkin13 is now top2 0.815 E64)
\nDay 79, 1/11 no change: LB 0.815 Public: 0.812 (\"tmp\" is the second to break 0.815, 18 teams above 0.814, )

\n

\"\"

", "votes": 1, "replies": [] }, { "id": 2001765, "author_name": "Alexander Chervov", "author_url": "", "post_date": "2022-10-24T09:48:37.560000", "content": "

Day 70, 23/10 no change: LB 0.815 Public: 0.812 (5 teams above 0.814)
\n\"\"

", "votes": 1, "replies": [ { "id": 2001786, "author_name": "Jose Carmona", "author_url": "", "post_date": "2022-10-24T09:59:51.440000", "content": "

Senkin hopes to beat .815 limit
\n\"\"

", "votes": 3, "replies": [] } ] }, { "id": 1979933, "author_name": "Alexander Chervov", "author_url": "", "post_date": "2022-10-09T20:25:31.010000", "content": "

Day 56, 9/10 no change: LB 0.814 Public: 0.811

\n

\"\"

", "votes": 1, "replies": [] }, { "id": 1957893, "author_name": "Alexander Chervov", "author_url": "", "post_date": "2022-09-27T07:41:42.060000", "content": "

Percent of HSC cells decrease daily,
\nit might be \"differentiation\" (i.e. transformation to other cell types) or just worse survival.

\n

Probably for day 10, it will be even less HSC.
\nThus if models depend on types - we need to take that into account.

\n

https://www.kaggle.com/code/ryumei1987/msci-eda?scriptVersionId=106560721&cellId=9
\n\"\"

", "votes": 1, "replies": [] }, { "id": 1955133, "author_name": "Alexander Chervov", "author_url": "", "post_date": "2022-09-25T18:29:02.313000", "content": "

Day 41, 25/09 no change: LB 0.814 Public: 0.811 ( MT E81 and AmbrosM achieved 0.812 E38 - Top2 and Top4)

\n

\"\"

", "votes": 1, "replies": [ { "id": 1955595, "author_name": "INF", "author_url": "", "post_date": "2022-09-26T04:22:39.170000", "content": "

I wander what makes so many people achieved 813 just one day

", "votes": 2, "replies": [] }, { "id": 1956151, "author_name": "Alexander Chervov", "author_url": "", "post_date": "2022-09-26T10:01:54.540000", "content": "

I guess it is Sunday. People have free time for Kaggle. Not sure I am right. Just hypothesis

", "votes": 1, "replies": [] }, { "id": 1968022, "author_name": "Alexander Chervov", "author_url": "", "post_date": "2022-10-02T20:10:26.257000", "content": "

Day 48, 2/10 no change: LB 0.814 Public: 0.811

\n

\"\"

", "votes": 1, "replies": [] } ] }, { "id": 1947412, "author_name": "Jose Carmona", "author_url": "", "post_date": "2022-09-20T12:57:00.453000", "content": "

Hi Alexander:

\n

Great work and very useful!

\n

Thanks for sharing

", "votes": 1, "replies": [] }, { "id": 2031183, "author_name": "Jose Carmona", "author_url": "", "post_date": "2022-11-15T23:19:17.987000", "content": "

Hi @alexandervc,

\n

Thank for this great thread. It was very useful to me and was a perfect daily report about the competition status. I hope you be luck in the final ranking

", "votes": 2, "replies": [] }, { "id": 1988157, "author_name": "Alexander Chervov", "author_url": "", "post_date": "2022-10-15T05:43:28.937000", "content": "

Pay attention - new data has been issued - raw counts:

\n

https://www.kaggle.com/competitions/open-problems-multimodal/discussion/359355

\n

Day 61, 14/10 LB 0.814 Public: 0.811 (New top public: 0.811+ JUAN SMITH PERERA Adding to the Keras model a grouping based on donor x days. .

\n

Congratulations to the second team reaching 0.814:

\n

definitelynot KhaVo+MT

\n

\"\"

", "votes": 2, "replies": [] }, { "id": 1979954, "author_name": "Jose Carmona", "author_url": "", "post_date": "2022-10-09T20:52:05.610000", "content": "

It seems that we are blocked

", "votes": 2, "replies": [] }, { "id": 1955245, "author_name": "Alexander Chervov", "author_url": "", "post_date": "2022-09-25T21:22:09.527000", "content": "

That might be useful:
\n1) https://www.kaggle.com/code/konomuabe/average-of-gene-id-and-day
\n\"Simple Submission - Average by gene_id scored 0.741 This note book calculates average of gene_id grouped by the day. But the score is 0.748.
\nDay may not affect the results much.
\nLooking at CV, citeseq improves 0.0035 and multiome improves 0.0068 in correlation if days are taken into account.
\n\"
\nRemark: 0.741 - the scores BEFORE leak correction - now one should substruct about 0.048.
\nThe pure average now gives 0.718 - see - https://www.kaggle.com/code/shuntarotanaka/simple-submission-average-by-gene-id

\n

2)
\nAverages with respect to cell type give: 0.760 ! (Improvement from 0.718 for simple averages )
\nSee https://www.kaggle.com/code/norifumiirie/simple-submission-mean-by-gene-id-and-cell-type?scriptVersionId=106556768

", "votes": 2, "replies": [] }, { "id": 1937997, "author_name": "", "author_url": "", "post_date": "2022-09-13T19:57:21.767000", "content": "", "votes": 0, "replies": [] }, { "id": 2029159, "author_name": "", "author_url": "", "post_date": "2022-11-14T13:47:18.097000", "content": "

Wow, thank you this is great!!

", "votes": 2, "replies": [] } ], "raw_markdown_by_id": { "1916402": "Welcome to add your findings in comments here.\n\nThat is was great and hard competition ! Thanks to organizers and congratulations to everybody who gained prizes/medals/experience/fun... ! \n\n**Day 93 15/11** no change: LB 0.816 Public: 0.812 - the last day of the competition\n**Day 92 14/11** no change: LB 0.816 Public: 0.812 (Incredible fighting top2-10 LB is changing very fast. 9 teams above 0.815, 45 teams above 0.814)\n**Day 91, 13/11** no change: LB 0.816 Public: 0.812 (The fight is very tough top2-5 positions are quite interchanging,\nsubmissions can be seen every hour. 7 teams above 0.815. 30 teams above 0.814. The poll for shake-up reveals some fears: https://t.me/sberlogacompete/3232 )\n**Day 90, 12/11** no change: LB 0.816 Public: 0.812 \n(The fight for the top2-3 places is very tough - positions were changed several times per day;\nTeams: [Kha|MT|B|Ambros], [Risk-ZaloPay] Aggressive, [Protein Shake]. 5 Teams above 0.815, 23 teams above 0.814 )\n**Day 88, 10/11** no change: LB 0.815 Public: 0.812\n**Day 87, 9/11** **!!! Breakthrough LB 0.816 !!!** Public: 0.812 (Senkin&tmp break 0.816. Fourth team achieve 0.815 \"Protein Shake\" E191, 21 team above 0.814 )\n**Day 86, 8/11** no change: LB 0.815 Public: 0.812\n**Day 85, 7/11** no change: LB 0.815 Public: 0.812\n**Day 84, 6/11** no change: LB 0.815 Public: 0.812+ ([New top public blend appeared](https://www.kaggle.com/code/liullllll/5-5-msci22-ensembling-citeseq), but still 0.812. Above 0.814 - 19 teams) \n**Day 83, 5/11** no change: LB 0.815 Public: 0.812 (Third team break 0.815 - Kha | MT | B | Ambros E268)\n**Day 82, 4/11** no change: LB 0.815 Public: 0.812\n**Day 81, 3/11** no change: LB 0.815 Public: 0.812 (Dream teamed formed - Senkin13&\"tmp\", top boosting and top NN joined together, any one can beat them ?)\n(By the way - at the early days of the competition in was written here - look on \"tmp's\"' solution and github: \n(https://www.kaggle.com/competitions/lish-moa/discussion/202256). It is not too late even now ).\n**Day 80, 2/11** no change: LB 0.815 Public: 0.812 (The first time top1 changed - \"tmp\" 0.815 E39, senkin13 is now top2 0.815 E64) \n**Day 79, 1/11** no change: LB 0.815 Public: 0.812 (\"tmp\" is the second to break 0.815, 18 teams above 0.814, )\n**Day 78, 31/10** no change: LB 0.815 Public: 0.812\n**Day 77, 30/10** no change: LB 0.815 Public: 0.812\n**Day 76, 29/10** no change: LB 0.815 Public: 0.812\n**Day 75, 28/10** no change: LB 0.815 Public: 0.812\n**Day 74, 27/10** no change: LB 0.815 Public: 0.812\n**Day 73, 26/10** no change: LB 0.815 Public: 0.812\n**Day 72, 25/10** no change: LB 0.815 Public: 0.812\n**Day 71, 24/10** no change: LB 0.815 Public: 0.812 (6 teams above 0.814)\n**Day 70, 23/10** no change: LB 0.815 Public: 0.812 (5 teams above 0.814)\n**Day 69, 22/10** no change: LB 0.815 Public: 0.812\n**Day 68, 21/10** no change: LB 0.815 Public: 0.812\n**Day 67, 20/10** no change: LB 0.815 Public: 0.812 , 4-th team achieved 0.814 on LB - \"\nHow to predict Citeseq\" (user: \"A Beginner\") E238 - Position 4. \n**Day 66, 19/10** **!!! Breakthrough LB 0.815** - Senkin13 E55 Public: 0.812 (After 30 days of 0.814 on LB and release of the new data - finally 0.815) \n**Day 65, 18/10** LB 0.814 Public increase: 0.812; The third team achieved 0.814 on LB - \"Protein Shake\" E124. Public 0.812: ( MEHRAN KAZEMINIA [Blend achieved 0.812](https://www.kaggle.com/code/mehrankazeminia/5-5-msci22-ensembling-citeseq)) and another: [0.812 LAURENT POURCHOT](https://www.kaggle.com/code/pourchot/all-in-one-citeseq-multiome-with-keras)\n**Day 64, 17/10** no change: LB 0.814 Public: 0.811 \n**Day 63, 16/10** no change: LB 0.814 Public: 0.811 \n**Day 62, 15/10** no change: LB 0.814 Public: 0.811 \n**Day 61, 14/10** LB 0.814 (Senkin13 E48 - no change) ; small change for public top: : 0.811 (New top public: [0.811+ JUAN SMITH PERERA Adding to the Keras model a grouping based on donor x days. ](https://www.kaggle.com/code/jsmithperera/citeseq-keras-multiome-5x5).\nThe second team reached 0.814: definitelynot KhaVo+MT\n**Day 60, 13/10** no change: LB 0.814 Public: 0.811 \n**Day 59, 12/10** no change: LB 0.814 Public: 0.811 . [New data has been issued. ](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/359355) \n**Day 58, 11/10** no change: LB 0.814 Public: 0.811 \n**Day 57, 10/10** no change: LB 0.814 Public: 0.811 \n**Day 56, 9/10** no change: LB 0.814 Public: 0.811 \n**Day 55, 8/10** no change: LB 0.814 Public: 0.811 \n**Day 54, 7/10** no change: LB 0.814 Public: 0.811 \n**Day 53, 6/10** no change: LB 0.814 Public: 0.811 \n**Day 52, 5/10** no change: LB 0.814 Public: 0.811 \n**Day 51, 4/10** no change: LB 0.814 Public: 0.811 \n**Day 50, 3/10** no change: LB 0.814 Public: 0.811 \n**Day 49, 2/10** no change: LB 0.814 Public: 0.811 \n**Day 47, 1/10** no change: LB 0.814 Public: 0.811 \n**Day 46, 30/09** no change: LB 0.814 Public: 0.811 \n**Day 45, 29/09** no change: LB 0.814 Public: 0.811 \n**Day 44, 28/09** no change: LB 0.814 Public: 0.811 \n**Day 43, 27/09** no change: LB 0.814 Public: 0.811 \n**Day 42, 26/09** no change: LB 0.814 Public: 0.811 \n**Day 41, 25/09** no change: LB 0.814 Public: 0.811 ( MT E81 and AmbrosM achieved 0.812 E38 - Top2 and Top4) \n**Day 40, 24/09** no change: LB 0.814 Public: 0.811 \n**Day 39, 23/09** no change: LB 0.814 Public: 0.811 \n**Day 38, 22/09** no change: LB 0.814 Public: 0.811 \n**Day 37, 21/09** no change: LB 0.814 Public: 0.811 (Magnus achieved 0.812 = Top3) \n**Day 36, 20/09** no change: LB 0.814 Public: 0.811 \n**Day 35, 19/09** **!!! Breakthrough LB 0.814 !!!**LB 0.814 (Finally senkin13 achieved 0.814 E27) Public: 0.811 \n**Day 34, 18/09** LB 0.813+ Public: 0.811 (new , a little better score, but less blend - [Keras + Catboost + some blend](https://www.kaggle.com/code/pourchot/multiome-with-keras-ensemble))\n**Day 33, 17/09** no change: LB 0.813 Public: 0.811\n**Day 32, 16/09** no change: LB 0.813 Public: 0.811\n**Day 31, 15/09** no change: LB 0.813 Public: 0.811 (Silogram achieved 0.813 E41 , and became N2) \n**Day 30, 14/09** no change: LB 0.813 Public: 0.811\n**Day 29, 13/09** no change: LB 0.813 Public: 0.811\n**Day 28, 12/09** no change: LB 0.813 Public: 0.811\n**Day 27, 11/09** no change: LB 0.813 Public: 0.811\n**Day 26, 10/09** no change: LB 0.813 Public: 0.811\n**Day 25, 09/09** Rescoring process finished (hopefully). The top of LB is basically the same: senkin13: 0.813\n15, Btbpanda 0.812 25, Mustafa Keser 0.812 79, Silogram 0.812 39. About 0.048 below the old one. [Top public: 0.811](https://www.kaggle.com/code/vslaykovsky/lb-0-811-normalized-ensembles-for-pearson-s-r/notebook?scriptVersionId=105258966) \n**Day 24, 08/09** Rescoring process not finished yet (restarted)\n**Day 23, 07/09** **[Data Update and Rescore - exclude data leak](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/350933). SCORES CHANGE approximately by 0.048 down**\n**Day 22, 06/09** LB 0.860 (Btbpanda E25). Public: 0.858 Several. (S: 0.860 35, AC: 0.858 43, AV 0.860 25 S13 0.859 11)\n**Day 21, 05/09** LB 0.860 (Btbpanda E24). Public: 0.858 Several. (S: 0.859 32, AC: 0.858 42, AV 0.860 24 S13 0.859 11)\n**Day 20, 04/09** LB 0.860 (Mustafa Keser E54). Public: 0.858 [CITEseq Keras] (https://www.kaggle.com/code/ambrosm/msci-citeseq-keras-quickstart) (AMBROSM) (S: 0.859 27, AC: 0.857 36, AV 0.859 22 S13 0.859 8)\n**Day 19, 03/09** LB 0.859 (Btbpanda, E19). Public: 0.853 [AMBROSM](https://www.kaggle.com/code/ambrosm/msci-citeseq-quickstart). Some scores S 0.859, 27, AC 0.855 31, S13 0.854 4\n**Day 18, 02/09** LB Same. Public: 0.848 ([Similar to previous top public ](https://www.kaggle.com/code/jsmithperera/multiome-quickstart-w-sparse-m-tsvd-32)) (J. S. Perera). Some scores S: 0.856, 22, AC: 0.850 27\n **Day 17, 01/09** NO change. Some scores S: 0.848 17, AC: 0.849 24 \n**Day 16, 31/08** LB: 0.858 (minhtu.mt.mt, E30), Public: 0.847 [(PCA+RIDGE on Multiome made Sparse)](https://www.kaggle.com/code/fabiencrom/msci-multiome-quickstart-w-sparse-matrices) FABIEN CROM\n**Day 15, 30/08** LB: 0.855 (Jie Wu, E27), same: Public: same : 0.834 (LGBM+Optuna+Drop Const)\n**Day 14, 29/08** same: LB: 0.854 (E25), same: Public: same : 0.834 (LGBM+Optuna+Drop Const)\n**Day 13, 28/08** LB: 0.854 (E25), Public: same : 0.834 (LGBM+Optuna+Drop Const)\n**Day 12, 27/08** LB: 0.848 (E12), Public: 0.834 (LGBM+Optuna+Drop Const)\n\n- **New data**\n-- [New data has been issued. ](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/359355)\n\n==\n\n- **Feature Engineering**\n-- [Feature shop for you - lots of engineered features by dimensional reduction and clustering](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/359683)\n-- Similar for Multiome - https://www.kaggle.com/datasets/stasborodynkin/feature-shop-for-mmscel-multiome\n- **Publics:** \n-- 06 11 2002: [New top public blend appeared](https://www.kaggle.com/code/liullllll/5-5-msci22-ensembling-citeseq), but still 0.812\n-- [Useful discussion on models, MLP, Keras-NN, Catboost](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/359866)\n-- [0.812MEHRAN KAZEMINIA ](https://www.kaggle.com/code/mehrankazeminia/5-5-msci22-ensembling-citeseq)\n-- [0.812 LAURENT POURCHOT](https://www.kaggle.com/code/pourchot/all-in-one-citeseq-multiome-with-keras)\n-- [0.811+ JUAN SMITH PERERA Adding to the Keras model a grouping based on donor x days. ](https://www.kaggle.com/code/jsmithperera/citeseq-keras-multiome-5x5)\n-- [0.811+ LAURENT POURCHOT Keras + Catboost + some blend](https://www.kaggle.com/code/pourchot/multiome-with-keras-ensemble)\n-- [0.811 JOSE CARMONA idea - be careful with blend - look separately Multiome and CITEseq](https://www.kaggle.com/code/josecarmona/msci22-keep-in-mind-2in1/notebook?scriptVersionId=105880791) \n-- [0.811 VLADIMIR SLAYKOVSKIY Normalized Ensembles ](https://www.kaggle.com/code/vslaykovsky/lb-0-811-normalized-ensembles-for-pearson-s-r/notebook?scriptVersionId=105258966) \n-- 0.81 [Citeseq: TrancSVD->Keras Dense 4Layers with Dropout (with tune params by KerasTuner); Multiome: CatBoost by XiaFire](https://www.kaggle.com/code/sskknt/msci-citeseq-keras-quickstart-dropout/notebook?scriptVersionId=105219293)\n-- 0.81 [CATboost-regressor Multiome](https://www.kaggle.com/code/xiafire/lb-t15-msci-multiome-catboostregressor)\n-- 0.807 [TabNet on CITEseq ; on Multiome not the best solution](https://www.kaggle.com/code/tamaryo/lb-0-805-citeseq-tabnet-baseline)\n-- (0.858old) [CITEseq Keras](https://www.kaggle.com/code/ambrosm/msci-citeseq-keras-quickstart) (AMBROSM)\n-- 0.803 (0.853old) [AMBROSM](https://www.kaggle.com/code/ambrosm/msci-citeseq-quickstart) - merge LGBM on CITEseq with PCA+RIDGE on Multiome \n-- (0.848old) ([Similar to previous top public ](https://www.kaggle.com/code/jsmithperera/multiome-quickstart-w-sparse-m-tsvd-32)) (J. S. Perera).\n-- 0.803 (0.847old) [(PCA+RIDGE on Multiome made Sparse)](https://www.kaggle.com/code/fabiencrom/msci-multiome-quickstart-w-sparse-matrices) FABIEN CROM\n-- 0.794 (0.83, 0834old) - [LGBM+Optuna on CiteSeq](https://www.kaggle.com/code/vuonglam/lgbm-baseline-optuna-drop-constant-cite-task)\n-- 0.792 [ SWIMMY【LGBM Baseline】MSCI CITEseq]( https://www.kaggle.com/code/swimmy/lgbm-baseline-msci-citeseq)\n-- (0.824old) - [LGBM on CiteSeq](https://www.kaggle.com/code/ambrosm/msci-citeseq-quickstart)\n-- (0.814old) - [PCA+Ridge on CiteSeq](https://www.kaggle.com/code/ambrosm/msci-citeseq-quickstart)\n-- (0.741old) - [Just averages](https://www.kaggle.com/code/shuntarotanaka/simple-submission-average-by-gene-id)\n- **Postprocessing:**\n-- [Normalize to 1e6 etc](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/349132) \n- **Data Tricks:**\n-- Conversion to sparse of multiome data - now it fits kaggle RAM ([Notebook](https://www.kaggle.com/code/sbunzini/reduce-memory-usage-by-95-with-sparse-matrices))\n- **Technology:**\n-- Saturn cloud with big RAM is accessible\n- **Problems:** \n-- [Newly provided \"test\" file contain more features](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/350933#1931702) and see [also](https://www.kaggle.com/code/erivanoliveirajr/multimodal-single-cell-integration/data)\n-- [Data Lick found (resolved 23-25.09)](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/347890)\n-- [Shake-up inevitable](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/347202)\n- **Related research**\n-- [Collection of links to papers, videos, etc ](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/351038)\n- **Strange things:** \n-- Negative values in protein measurements. Organizers: [\"I agree this is weird! \" ](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/346210)\n- **Soft Questions:** \n-- Why just average solution gives such high score ? Seems answer - variation of targets around mean is not big, mean is easily predictable \n- **Suggestions:** \n-- It is multitarget, so we need neural networks, might look at MoA examples e.g. nice [top2](https://www.kaggle.com/competitions/lish-moa/discussion/202256): \n- **Events:** \n-- Introductory lectures related to Kaggle and Biology are planned: see https://www.kaggle.com/competitions/open-problems-multimodal/discussion/348661\n- **Biology:** \n-- Super cool ! [Donors - 3 men and 1 woman](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/348761) (by Y chromosome in ATAC-seq data) \n-- [Nice UMAP](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/348117) figures, day 3|HSC - outlier. Why ? What is going on ? Differentiation ? But why it disappears on day 4 ? Something unclear is here\n-- [Details on biological processing](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/348761)\n-- [Cell proliferation cycle analysis](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/350314)\n-- [Analysis of correlations and some findings](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/351725)\n-- Seems ATAC-seq it is not really changing [Heatmap of ATAC-seq](https://www.kaggle.com/code/norifumiirie/heatmap-of-multiome-data?scriptVersionId=105460251&cellId=30) and same [by chromosome](https://www.kaggle.com/alexandervc/heatmap-of-atac-seq-multiome-data)\n\n \n ", "2032072": "Thanks for your effort for this competition, your thread is always interesting and informative.", "2029780": "**Day 92 14/11** no change: LB 0.816 Public: 0.812 (Incredible fighting top2-10 LB is changing very fast. 9 teams above 0.815, 45 teams above 0.814)\n\nLB is changing so fast:\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2Fc7b8792c2af75221844395388e01e544%2FScreenshot%202022-11-14%20234150.png?generation=1668465729638918&alt=media)", "2028425": "**Day 91, 13/11 no change: LB 0.816 Public: 0.812**\n (The fight is very tough - top2-5 positions are quite interchanging,\nsubmissions can be seen every hour. 7 teams above 0.815. 30 teams above 0.814. The poll for shake-up reveals some fears: https://t.me/sberlogacompete/3232 )\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2F6ca1402184667582da6e31ab1e866549%2FScreenshot%202022-11-13%20233712.png?generation=1668379062800764&alt=media)", "2023366": "**Day 87, 9/11 !!! Breakthrough LB 0.816 !!!** Public: 0.812 (Senkin&tmp break 0.816. Fourth team achieve 0.815 \"Protein Shake\" E191, 21 team above 0.814 )\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2F607b277430115f1a54251a3ef63e1b4f%2FScreenshot%202022-11-09%20184744.png?generation=1668016075717636&alt=media)", "2019653": "**Day 84, 6/11** no change: LB 0.815 Public: 0.812+ ([New top public blend appeared](https://www.kaggle.com/code/liullllll/5-5-msci22-ensembling-citeseq), but still 0.812. Above 0.814 - 19 teams) \n**Day 83, 5/11** no change: LB 0.815 Public: 0.812 (Third team break 0.815 - Kha | MT | B | Ambros E268)\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2F3796167a1e14bb819235e4ce179b78be%2FScreenshot%202022-11-06%20204013.png?generation=1667764190148097&alt=media)", "2014282": "**Day 80, 2/11** no change: LB 0.815 Public: 0.812 (The first time top1 changed \"tmp\" 0.815 E39, senkin13 is now top2 0.815 E64) \n**Day 79, 1/11** no change: LB 0.815 Public: 0.812 (\"tmp\" is the second to break 0.815, 18 teams above 0.814, )\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2Fa587dbbc099b34d2a35b8060e7f2ec14%2FScreenshot%202022-11-02%20143707.png?generation=1667396277264497&alt=media)", "2001765": "**Day 70, 23/10** no change: LB 0.815 Public: 0.812 (5 teams above 0.814)\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2Fb222f0c2313434240f6e6b756c220ac8%2FScreenshot%202022-10-23%20212045.png?generation=1666604614764911&alt=media)", "1979933": "**Day 56, 9/10** no change: LB 0.814 Public: 0.811 \n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2F13f1d3ebda3c48b93b2a360fb3c192e4%2FScreenshot%202022-10-09%20222219.png?generation=1665347026223790&alt=media)", "1957893": "Percent of HSC cells decrease daily,\nit might be \"differentiation\" (i.e. transformation to other cell types) or just worse survival.\n\nProbably for day 10, it will be even less HSC.\nThus if models depend on types - we need to take that into account. \n\nhttps://www.kaggle.com/code/ryumei1987/msci-eda?scriptVersionId=106560721&cellId=9\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2F5139dd2094f420998486efd6056cedf5%2FScreenshot%202022-09-27%20093943.png?generation=1664264395840435&alt=media)", "1955133": "**Day 41, 25/09** no change: LB 0.814 Public: 0.811 ( MT E81 and AmbrosM achieved 0.812 E38 - Top2 and Top4)\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2F4f13f9ee8d0d93cb7e6654d6358136e5%2FScreenshot%202022-09-25%20202808.png?generation=1664130537597986&alt=media)\n", "1947412": "Hi Alexander:\n\nGreat work and very useful!\n\nThanks for sharing", "2031183": "Hi @alexandervc,\n\nThank for this great thread. It was very useful to me and was a perfect daily report about the competition status. I hope you be luck in the final ranking", "1988157": "## Pay attention - new data has been issued - raw counts:\nhttps://www.kaggle.com/competitions/open-problems-multimodal/discussion/359355\n\n**Day 61, 14/10** LB 0.814 Public: 0.811 (New top public: 0.811+ JUAN SMITH PERERA Adding to the Keras model a grouping based on donor x days. .\n\n### Congratulations to the second team reaching 0.814:\ndefinitelynot KhaVo+MT\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2F0aae3156cce1353dddf8e535c3fb8568%2FScreenshot%202022-10-15%20074258.png?generation=1665812596198739&alt=media)\n", "1979954": "It seems that we are blocked", "1955245": "That might be useful: \n1) https://www.kaggle.com/code/konomuabe/average-of-gene-id-and-day\n\"Simple Submission - Average by gene_id scored 0.741 This note book calculates average of gene_id grouped by the day. But the score is 0.748. \nDay may not affect the results much.\nLooking at CV, citeseq improves 0.0035 and multiome improves 0.0068 in correlation if days are taken into account.\n\"\nRemark: 0.741 - the scores BEFORE leak correction - now one should substruct about 0.048. \nThe pure average now gives 0.718 - see - https://www.kaggle.com/code/shuntarotanaka/simple-submission-average-by-gene-id\n\n2) \nAverages with respect to cell type give: 0.760 ! (Improvement from 0.718 for simple averages )\nSee https://www.kaggle.com/code/norifumiirie/simple-submission-mean-by-gene-id-and-cell-type?scriptVersionId=106556768 \n\n\n\n", "1937997": "", "2029159": "Wow, thank you this is great!!" } }