{
  "id": 381318,
  "title": "Abnormal scores of our team",
  "url": "/competitions/otto-recommender-system/discussion/381318",
  "author_name": "",
  "post_date": "2023-01-26T04:38:15.937873Z",
  "votes": 133,
  "comment_count": 33,
  "views": 0,
  "content": "<p>I and my student lily participated in this completion about one month ago and achieved 0.597 score about 5 days ago. RunningZ contacted me by WeChat on January 21, 2023, and wanted to join our team. I knew him in KDD CUP 2020, which is also a recommendation system competition (KDD Cup 2020 Challenges for Modern E-Commerce Platform: Debiasing). He was a team leader and ranked 3rd finally. I was another team leader and ranked 6th. I think we could get a better score after he joins our team, and invited him and shared him with our codes.<br>\nOn January 24, he submitted an ensemble submission and achieved an excellent score (0.601). I was shocked by the ensemble, and he just said he did voting, weighting and stacking based on our previous submissions and our codes. Then, he let me make him as leader and contacted other competitors to merge teams. Finally, Konstantin Gavrilchik and Ilya los agreed to join our team. Konstantin Gavrilchik created a Slack channel to share solutions and discuss problems. <br>\nOn January 25, RunningZ contacted me by WeChat and let me share our solution and let me say our best single model achieved 0.599 score, which is something weird. I briefly introduced our solution and claimed that our best single model is 0.597 and the ensemble solution by RunningZ can achieve 0.603. However, I don’t know exactly how he did it. After that, I asked him by WeChat and wanted him to provide the ensemble code with me, but he said his code was messy and let me continue to give him results of single models. Actually, although I have achieved top ranks in several recommendation system competitions, I haven’t tried the ensemble method to vote on multiple submissions, which may be useful to improve performance. <br>\nAfter a few hours, I checked my email and found someone told me I should focus on the ensemble pipeline by RunningZ, and I talked to RunningZ by  WeChat. He promised to share his code with team members in the evening. The ensemble performance also surprises Konstantin Gavrilchik and Ilya los. However, RunningZ has not reproduced the submission and provided his codes until now. And he was inconsistent in his words in the chat history of WeChat and Slack.<br>\nWe wish Kaggle could handle this matter. And a suggestion (<a href=\"https://www.kaggle.com/competitions/otto-recommender-system/discussion/380783#2115469\" target=\"_blank\">https://www.kaggle.com/competitions/otto-recommender-system/discussion/380783#2115469</a>) may be useful to team up in Kaggle competitions. Code verification is also necessary for gold solutions, and the solutions should be posted on github. My students and I always did this, such as CIKM AnalytiCup 2019 (<a href=\"https://github.com/ChuanyuXue/CIKM-2019-AnalytiCup)\" target=\"_blank\">https://github.com/ChuanyuXue/CIKM-2019-AnalytiCup)</a>, KDD CUP 2020 (<a href=\"https://github.com/ChuanyuXue/KDDCUP-2020\" target=\"_blank\">https://github.com/ChuanyuXue/KDDCUP-2020</a>) and WSDM CUP 2022 (<a href=\"https://github.com/hansu1017/WSDM-CUP-2022-Retention-Score-Prediction)\" target=\"_blank\">https://github.com/hansu1017/WSDM-CUP-2022-Retention-Score-Prediction)</a>. Eventually, I am very sorry to have involved Konstantin Gavrilchik and Ilya los in this accident.</p>",
  "messages": [
    {
      "id": "2115939",
      "postDate": "01/26/2023 04:38:15",
      "content": "<p>I and my student lily participated in this completion about one month ago and achieved 0.597 score about 5 days ago. RunningZ contacted me by WeChat on January 21, 2023, and wanted to join our team. I knew him in KDD CUP 2020, which is also a recommendation system competition (KDD Cup 2020 Challenges for Modern E-Commerce Platform: Debiasing). He was a team leader and ranked 3rd finally. I was another team leader and ranked 6th. I think we could get a better score after he joins our team, and invited him and shared him with our codes.<br>\nOn January 24, he submitted an ensemble submission and achieved an excellent score (0.601). I was shocked by the ensemble, and he just said he did voting, weighting and stacking based on our previous submissions and our codes. Then, he let me make him as leader and contacted other competitors to merge teams. Finally, Konstantin Gavrilchik and Ilya los agreed to join our team. Konstantin Gavrilchik created a Slack channel to share solutions and discuss problems. <br>\nOn January 25, RunningZ contacted me by WeChat and let me share our solution and let me say our best single model achieved 0.599 score, which is something weird. I briefly introduced our solution and claimed that our best single model is 0.597 and the ensemble solution by RunningZ can achieve 0.603. However, I don’t know exactly how he did it. After that, I asked him by WeChat and wanted him to provide the ensemble code with me, but he said his code was messy and let me continue to give him results of single models. Actually, although I have achieved top ranks in several recommendation system competitions, I haven’t tried the ensemble method to vote on multiple submissions, which may be useful to improve performance. <br>\nAfter a few hours, I checked my email and found someone told me I should focus on the ensemble pipeline by RunningZ, and I talked to RunningZ by  WeChat. He promised to share his code with team members in the evening. The ensemble performance also surprises Konstantin Gavrilchik and Ilya los. However, RunningZ has not reproduced the submission and provided his codes until now. And he was inconsistent in his words in the chat history of WeChat and Slack.<br>\nWe wish Kaggle could handle this matter. And a suggestion (<a href=\"https://www.kaggle.com/competitions/otto-recommender-system/discussion/380783#2115469\" target=\"_blank\">https://www.kaggle.com/competitions/otto-recommender-system/discussion/380783#2115469</a>) may be useful to team up in Kaggle competitions. Code verification is also necessary for gold solutions, and the solutions should be posted on github. My students and I always did this, such as CIKM AnalytiCup 2019 (<a href=\"https://github.com/ChuanyuXue/CIKM-2019-AnalytiCup)\" target=\"_blank\">https://github.com/ChuanyuXue/CIKM-2019-AnalytiCup)</a>, KDD CUP 2020 (<a href=\"https://github.com/ChuanyuXue/KDDCUP-2020\" target=\"_blank\">https://github.com/ChuanyuXue/KDDCUP-2020</a>) and WSDM CUP 2022 (<a href=\"https://github.com/hansu1017/WSDM-CUP-2022-Retention-Score-Prediction)\" target=\"_blank\">https://github.com/hansu1017/WSDM-CUP-2022-Retention-Score-Prediction)</a>. Eventually, I am very sorry to have involved Konstantin Gavrilchik and Ilya los in this accident.</p>",
      "rawMarkdown": "I and my student lily participated in this completion about one month ago and achieved 0.597 score about 5 days ago. RunningZ contacted me by WeChat on January 21, 2023, and wanted to join our team. I knew him in KDD CUP 2020, which is also a recommendation system competition (KDD Cup 2020 Challenges for Modern E-Commerce Platform: Debiasing). He was a team leader and ranked 3rd finally. I was another team leader and ranked 6th. I think we could get a better score after he joins our team, and invited him and shared him with our codes.\nOn January 24, he submitted an ensemble submission and achieved an excellent score (0.601). I was shocked by the ensemble, and he just said he did voting, weighting and stacking based on our previous submissions and our codes. Then, he let me make him as leader and contacted other competitors to merge teams. Finally, Konstantin Gavrilchik and Ilya los agreed to join our team. Konstantin Gavrilchik created a Slack channel to share solutions and discuss problems. \nOn January 25, RunningZ contacted me by WeChat and let me share our solution and let me say our best single model achieved 0.599 score, which is something weird. I briefly introduced our solution and claimed that our best single model is 0.597 and the ensemble solution by RunningZ can achieve 0.603. However, I don’t know exactly how he did it. After that, I asked him by WeChat and wanted him to provide the ensemble code with me, but he said his code was messy and let me continue to give him results of single models. Actually, although I have achieved top ranks in several recommendation system competitions, I haven’t tried the ensemble method to vote on multiple submissions, which may be useful to improve performance. \nAfter a few hours, I checked my email and found someone told me I should focus on the ensemble pipeline by RunningZ, and I talked to RunningZ by  WeChat. He promised to share his code with team members in the evening. The ensemble performance also surprises Konstantin Gavrilchik and Ilya los. However, RunningZ has not reproduced the submission and provided his codes until now. And he was inconsistent in his words in the chat history of WeChat and Slack.\nWe wish Kaggle could handle this matter. And a suggestion (https://www.kaggle.com/competitions/otto-recommender-system/discussion/380783#2115469) may be useful to team up in Kaggle competitions. Code verification is also necessary for gold solutions, and the solutions should be posted on github. My students and I always did this, such as CIKM AnalytiCup 2019 (https://github.com/ChuanyuXue/CIKM-2019-AnalytiCup), KDD CUP 2020 (https://github.com/ChuanyuXue/KDDCUP-2020) and WSDM CUP 2022 (https://github.com/hansu1017/WSDM-CUP-2022-Retention-Score-Prediction). Eventually, I am very sorry to have involved Konstantin Gavrilchik and Ilya los in this accident.",
      "votes": null
    },
    {
      "id": "2115945",
      "postDate": "01/26/2023 04:50:12",
      "content": "<p>Thank you for the raising this issue. The next questions are </p>\n<ul>\n<li>How did RunningZ get that score?</li>\n<li>If this is the cheating, is this first time for him?</li>\n</ul>",
      "rawMarkdown": "Thank you for the raising this issue. The next questions are \n- How did RunningZ get that score?\n- If this is the cheating, is this first time for him?",
      "votes": null
    },
    {
      "id": "2115949",
      "postDate": "01/26/2023 04:56:06",
      "content": "<p>I was contacted by RunningZ and a other top gold solution guy separately currently in this competition, even before they submitted, just a few days back. They must be really pros to contact for team up even before making a sub. I am happy I did not team up.</p>\n<p>Also I really appreciate Bruce for openly raising the serious issue, even though it affects your team's chances in this competition.</p>\n<p>A jump from calculation 0.597 to 0.603 is fantastic, that of a superhuman, unless you already have some subs from the 0.6+ range already with you, question is from where did he get it ?</p>",
      "rawMarkdown": "I was contacted by RunningZ and a other top gold solution guy separately currently in this competition, even before they submitted, just a few days back. They must be really pros to contact for team up even before making a sub. I am happy I did not team up.\n\nAlso I really appreciate Bruce for openly raising the serious issue, even though it affects your team's chances in this competition.\n\nA jump from calculation 0.597 to 0.603 is fantastic, that of a superhuman, unless you already have some subs from the 0.6+ range already with you, question is from where did he get it ?",
      "votes": null
    },
    {
      "id": "2115979",
      "postDate": "01/26/2023 05:24:54",
      "content": "<p>Thank you very much, Bruce!</p>\n<p>It was me that emailed Bruce to pay attention to the details of the submission scoring 0.603 because I found they jumped to top rank just a few hours after my team exchanged the prediction files on slack. </p>\n<p>And someone told me one of Bruce's teammate is related with a man in my team. </p>\n<p>Immediately, I contacted Bruce, a trusted teacher, to take a check on that. </p>\n<p>Until now, things are very suspicious. But I think we could verify something by a detailed check.</p>\n<p>I love kaggle. Hope everyone is clean and I am just mistaken to have the suspect and there are no more bad influence. </p>",
      "rawMarkdown": "Thank you very much, Bruce!\n\nIt was me that emailed Bruce to pay attention to the details of the submission scoring 0.603 because I found they jumped to top rank just a few hours after my team exchanged the prediction files on slack. \n\nAnd someone told me one of Bruce's teammate is related with a man in my team. \n\nImmediately, I contacted Bruce, a trusted teacher, to take a check on that. \n\nUntil now, things are very suspicious. But I think we could verify something by a detailed check.\n\nI love kaggle. Hope everyone is clean and I am just mistaken to have the suspect and there are no more bad influence.",
      "votes": null
    },
    {
      "id": "2116020",
      "postDate": "01/26/2023 06:16:24",
      "content": "<p>Obviously not his first time. I saw those two people appearing in gold zone during last weeks of competitions at least 10 times.</p>",
      "rawMarkdown": "Obviously not his first time. I saw those two people appearing in gold zone during last weeks of competitions at least 10 times.",
      "votes": null
    },
    {
      "id": "2116028",
      "postDate": "01/26/2023 06:20:54",
      "content": "<p>Thanks for sharing this <a href=\"https://www.kaggle.com/bruceqdu\" target=\"_blank\">@bruceqdu</a> even though it might jeopardize your team's result. I hope your and Konstantin's team won't be affected.</p>",
      "rawMarkdown": "Thanks for sharing this @bruceqdu even though it might jeopardize your team's result. I hope your and Konstantin's team won't be affected.",
      "votes": null
    },
    {
      "id": "2116031",
      "postDate": "01/26/2023 06:24:12",
      "content": "<p>I wished they had some way to stop affecting the honest kagglers who are affected by fraudsters in their team. But this is unfair to other people in the gold zone, as the best submissions of the alleged teams contains high scoring solutions, which are not completely their own</p>",
      "rawMarkdown": "I wished they had some way to stop affecting the honest kagglers who are affected by fraudsters in their team. But this is unfair to other people in the gold zone, as the best submissions of the alleged teams contains high scoring solutions, which are not completely their own",
      "votes": null
    },
    {
      "id": "2116036",
      "postDate": "01/26/2023 06:29:30",
      "content": "<p>These things happened again and again in last year. <br>\nIt's really good to point it out especially as a teammate.</p>",
      "rawMarkdown": "These things happened again and again in last year. \nIt's really good to point it out especially as a teammate.",
      "votes": null
    },
    {
      "id": "2116042",
      "postDate": "01/26/2023 06:35:18",
      "content": "<p>You are right but clearly those two teams show their true intentions. They are trying to cooperate by excluding the cheaters. I think we can trust them for not using cheaters' submissions. However cheaters can still sabotage the teams by using all of their submissions. A majority vote to kick someone from a team can be useful in those cases like in CSGO.</p>",
      "rawMarkdown": "You are right but clearly those two teams show their true intentions. They are trying to cooperate by excluding the cheaters. I think we can trust them for not using cheaters' submissions. However cheaters can still sabotage the teams by using all of their submissions. A majority vote to kick someone from a team can be useful in those cases like in CSGO.",
      "votes": null
    },
    {
      "id": "2116045",
      "postDate": "01/26/2023 06:38:58",
      "content": "<p>yes, the biggest problem is sabotaging. Also a cheater can easily download a submission from the submissions tab, and share with the other cheater in some other team. The other cheater can do the same. True csgo like implementation would be helpful :D</p>",
      "rawMarkdown": "yes, the biggest problem is sabotaging. Also a cheater can easily download a submission from the submissions tab, and share with the other cheater in some other team. The other cheater can do the same. True csgo like implementation would be helpful :D",
      "votes": null
    },
    {
      "id": "2116191",
      "postDate": "01/26/2023 09:47:03",
      "content": "<p>We worked in the Feedback2 and we got the gold. He shared his work in that competition, very clear.</p>",
      "rawMarkdown": "We worked in the Feedback2 and we got the gold. He shared his work in that competition, very clear.",
      "votes": null
    },
    {
      "id": "2116198",
      "postDate": "01/26/2023 09:51:55",
      "content": "<p>Yes, it is very important and honest to point such things out as teammates, even if it might hurt yourself in the short-term, but it will keep your own conscience clean. I strongly believe that honesty always wins in the long-term.</p>\n<p>Otherwise others will potentially never know about it. Maybe Kaggle needs a rating system for teammembers. It is very difficult for newcomers to find honest teammates, but even hard for veterans.</p>",
      "rawMarkdown": "Yes, it is very important and honest to point such things out as teammates, even if it might hurt yourself in the short-term, but it will keep your own conscience clean. I strongly believe that honesty always wins in the long-term.\n\nOtherwise others will potentially never know about it. Maybe Kaggle needs a rating system for teammembers. It is very difficult for newcomers to find honest teammates, but even hard for veterans.",
      "votes": null
    },
    {
      "id": "2116221",
      "postDate": "01/26/2023 10:10:52",
      "content": "<p>It's very cool and brave of you to clarify this even if this has a chance to cancel the score of your team.</p>",
      "rawMarkdown": "It's very cool and brave of you to clarify this even if this has a chance to cancel the score of your team.",
      "votes": null
    },
    {
      "id": "2116247",
      "postDate": "01/26/2023 10:50:13",
      "content": "<p>Totally agree. I can't sleep if my gold medals are unclean. <br>\nWe are all data scientists and I know many of us already suspect them for long time but have no evidence.<br>\nSo I am really happy that bruce can point it out.</p>",
      "rawMarkdown": "Totally agree. I can't sleep if my gold medals are unclean. \nWe are all data scientists and I know many of us already suspect them for long time but have no evidence.\nSo I am really happy that bruce can point it out.",
      "votes": null
    },
    {
      "id": "2116510",
      "postDate": "01/26/2023 14:43:33",
      "content": "<p>Honesty is Golden.</p>",
      "rawMarkdown": "Honesty is Golden.",
      "votes": null
    },
    {
      "id": "2116606",
      "postDate": "01/26/2023 15:44:56",
      "content": "<p>It's a pity for you and the other teammates who worked so hard at this competition. I was also a victim of the same problem as you in the G2Net Gravitational Wave Detection contest and then our private team results were removed (this was expected). Wishing the best for everyone who has worked hard on your team and Kaggle will make decisions that are fairest to all teams!!!</p>",
      "rawMarkdown": "It's a pity for you and the other teammates who worked so hard at this competition. I was also a victim of the same problem as you in the G2Net Gravitational Wave Detection contest and then our private team results were removed (this was expected). Wishing the best for everyone who has worked hard on your team and Kaggle will make decisions that are fairest to all teams!!!",
      "votes": null
    },
    {
      "id": "2116751",
      "postDate": "01/26/2023 17:39:38",
      "content": "<p>Kaggle should help all honest people and ban those cheaters!<br>\nSooooooo many organized cheating can be found in social media like ‘xiaohongshu’. This is just disgusting!<br>\nPretty sure there are much more cheaters, guys, please report if you found any suspicious activities!<br>\nWell done Bruce!</p>",
      "rawMarkdown": "Kaggle should help all honest people and ban those cheaters!\nSooooooo many organized cheating can be found in social media like ‘xiaohongshu’. This is just disgusting!\nPretty sure there are much more cheaters, guys, please report if you found any suspicious activities!\nWell done Bruce!",
      "votes": null
    },
    {
      "id": "2116770",
      "postDate": "01/26/2023 17:57:12",
      "content": "<p>\"Maybe Kaggle needs a rating system for teammembers.\"</p>\n<p>Before teaming up, team leader can request candidate to prove that his work is genuine through the below proposed kaggle verification service:</p>\n<p>This works the same as code requirement competition:</p>\n<ol>\n<li>candidate create a notebook </li>\n<li>candidate need to submit code and make prediction on the test data</li>\n<li>the sever compares the submission (and code) of the candiate against its database (i.e. submissions of other candidate) and check for abnormality. </li>\n<li>if everything is normal, a certificate is issued.</li>\n</ol>\n<p>based on the cerficate, the team leader can decide if he wants to accept the candidate into the team.</p>\n<p>the problem is how to detect abnormality? if kaggle cheater detection is good, then the issue is solved. else, someone needs to develope  cheater detection.</p>\n<p>alternative, we need some hidden data for step.2. or some special data that can detect cheater</p>",
      "rawMarkdown": "\"Maybe Kaggle needs a rating system for teammembers.\"\n \nBefore teaming up, team leader can request candidate to prove that his work is genuine through the below proposed kaggle verification service:\n\nThis works the same as code requirement competition:\n1. candidate create a notebook \n2. candidate need to submit code and make prediction on the test data\n3. the sever compares the submission (and code) of the candiate against its database (i.e. submissions of other candidate) and check for abnormality. \n4. if everything is normal, a certificate is issued.\n\nbased on the cerficate, the team leader can decide if he wants to accept the candidate into the team.\n\nthe problem is how to detect abnormality? if kaggle cheater detection is good, then the issue is solved. else, someone needs to develope  cheater detection.\n\nalternative, we need some hidden data for step.2. or some special data that can detect cheater",
      "votes": null
    },
    {
      "id": "2117423",
      "postDate": "01/27/2023 09:08:09",
      "content": "<p>Some past top kagglers maintained their status for way too long by doing just that: contacting top LB teams and joining them late in every compeittion. It does not make them cheaters still. Here is seems worse than that.</p>",
      "rawMarkdown": "Some past top kagglers maintained their status for way too long by doing just that: contacting top LB teams and joining them late in every compeittion. It does not make them cheaters still. Here is seems worse than that.",
      "votes": null
    },
    {
      "id": "2117430",
      "postDate": "01/27/2023 09:11:05",
      "content": "<p>Besides the sad story for you, this is great to read. I hope Kaggle will enforce you suggestion that every gold medal code should be made public. I didn't do it consistently in the past but I would if this is the rule from now.</p>\n<p>I once was disqualified because we (Giba and I) teamed we someone who cheated (he used 3 accounts). We were in gold in private lB before being removed. I can understand how you might feel. </p>",
      "rawMarkdown": "Besides the sad story for you, this is great to read. I hope Kaggle will enforce you suggestion that every gold medal code should be made public. I didn't do it consistently in the past but I would if this is the rule from now.\n\nI once was disqualified because we (Giba and I) teamed we someone who cheated (he used 3 accounts). We were in gold in private lB before being removed. I can understand how you might feel.",
      "votes": null
    },
    {
      "id": "2117664",
      "postDate": "01/27/2023 12:30:43",
      "content": "<p>Yes. It indeed had a bad influence on our passion and motivation to continue the competition. <br>\nActually, I don't need a medal to prove myself. One main reason I participated in this competition is to prepare materials for the next semester's course. And now the first lesson will be honesty and rules.<br>\nAdditionally, I wish kaggle could give Konstantin Gavrilchik and Ilya losthe the medals they deserve. </p>",
      "rawMarkdown": "Yes. It indeed had a bad influence on our passion and motivation to continue the competition. \nActually, I don't need a medal to prove myself. One main reason I participated in this competition is to prepare materials for the next semester's course. And now the first lesson will be honesty and rules.\nAdditionally, I wish kaggle could give Konstantin Gavrilchik and Ilya losthe the medals they deserve.",
      "votes": null
    },
    {
      "id": "2117813",
      "postDate": "01/27/2023 15:08:25",
      "content": "<p><a href=\"https://www.kaggle.com/bruceqdu\" target=\"_blank\">@bruceqdu</a> , You are the pride of kagglers ✔️</p>",
      "rawMarkdown": "bruceqdu , You are the pride of kagglers ✔️",
      "votes": null
    },
    {
      "id": "2117983",
      "postDate": "01/27/2023 17:27:12",
      "content": "<p>thank you for sharing</p>",
      "rawMarkdown": "thank you for sharing",
      "votes": null
    },
    {
      "id": "2118523",
      "postDate": "01/28/2023 04:28:01",
      "content": "<p>Couldn't agree more☝️</p>",
      "rawMarkdown": "Couldn't agree more☝️",
      "votes": null
    },
    {
      "id": "2118746",
      "postDate": "01/28/2023 08:38:28",
      "content": "<p>As a student, I can't find a team to play games with, and the results of playing games by myself are not very ideal. I would like to ask how to find a suitable team?🎶</p>",
      "rawMarkdown": "As a student, I can't find a team to play games with, and the results of playing games by myself are not very ideal. I would like to ask how to find a suitable team?🎶",
      "votes": null
    },
    {
      "id": "2119067",
      "postDate": "01/28/2023 13:33:46",
      "content": "<p>Thanks for being honest about everything. I hope you don't get discouraged by all of this.</p>\n<p>I can't imagine how you feel, but a lot of us know the feeling of working super hard and getting slapped in the face at the end. Mostly due to shake up, so I imagine this must feel even worse.</p>",
      "rawMarkdown": "Thanks for being honest about everything. I hope you don't get discouraged by all of this.\n\nI can't imagine how you feel, but a lot of us know the feeling of working super hard and getting slapped in the face at the end. Mostly due to shake up, so I imagine this must feel even worse.",
      "votes": null
    },
    {
      "id": "2122356",
      "postDate": "01/30/2023 21:49:34",
      "content": "<p><a href=\"https://www.kaggle.com/onodera\" target=\"_blank\">@onodera</a> it looks like he was removed from Santander competition</p>",
      "rawMarkdown": "onodera it looks like he was removed from Santander competition",
      "votes": null
    },
    {
      "id": "2123678",
      "postDate": "01/31/2023 16:23:19",
      "content": "<p>When I first started Kaggle, Santander Customer Transaction was around. I remember that RunningZ's team was removed on that competition. I think this incident is going on for years now. He also changed his bio from Master at BUAA to Master at Kaggle couple days ago like poteman removed his name from his repo. They are trying so hard not get IDed.</p>",
      "rawMarkdown": "When I first started Kaggle, Santander Customer Transaction was around. I remember that RunningZ's team was removed on that competition. I think this incident is going on for years now. He also changed his bio from Master at BUAA to Master at Kaggle couple days ago like poteman removed his name from his repo. They are trying so hard not get IDed.",
      "votes": null
    },
    {
      "id": "2124805",
      "postDate": "02/01/2023 08:15:01",
      "content": "<p>Thank you for posting these details, a small group of people are hurting the community and we need to resist them.</p>",
      "rawMarkdown": "Thank you for posting these details, a small group of people are hurting the community and we need to resist them.",
      "votes": null
    },
    {
      "id": "2126717",
      "postDate": "02/02/2023 12:13:34",
      "content": "<p>Thanks for the details.</p>",
      "rawMarkdown": "Thanks for the details.",
      "votes": null
    },
    {
      "id": "2127816",
      "postDate": "02/03/2023 07:53:40",
      "content": "<p>coming from another  thread</p>",
      "rawMarkdown": "coming from another  thread",
      "votes": null
    },
    {
      "id": "2170805",
      "postDate": "03/06/2023 09:44:39",
      "content": "<p>I was shocked when I heard this things happens. hope this won't happen agian. Thank you for your brave. wishing you could get better results in next competition! </p>",
      "rawMarkdown": "I was shocked when I heard this things happens. hope this won't happen agian. Thank you for your brave. wishing you could get better results in next competition!",
      "votes": null
    },
    {
      "id": "3007539",
      "postDate": "10/05/2024 14:07:56",
      "content": "<p>You can never make a good deal with a bad person.<br>\nSimple solution: Do not add an unknown teammate if you do not accept the worst-case scenario. </p>",
      "rawMarkdown": "You can never make a good deal with a bad person.\nSimple solution: Do not add an unknown teammate if you do not accept the worst-case scenario.",
      "votes": null
    },
    {
      "id": "3007544",
      "postDate": "10/05/2024 14:11:03",
      "content": "<p>Btw, I read many were shocked, this is normal human behavior. <br>\nOn the contrary, having high-grade ethics is the abnormal.</p>",
      "rawMarkdown": "Btw, I read many were shocked, this is normal human behavior. \nOn the contrary, having high-grade ethics is the abnormal.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2115945,
      "author_name": "onodera",
      "author_url": "",
      "post_date": "01/26/2023 04:50:12",
      "content": "<p>Thank you for the raising this issue. The next questions are </p>\n<ul>\n<li>How did RunningZ get that score?</li>\n<li>If this is the cheating, is this first time for him?</li>\n</ul>",
      "votes": null,
      "replies": [
        {
          "id": 2116020,
          "author_name": "gunesevitan",
          "author_url": "",
          "post_date": "01/26/2023 06:16:24",
          "content": "<p>Obviously not his first time. I saw those two people appearing in gold zone during last weeks of competitions at least 10 times.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 2116191,
          "author_name": "shinomoriaoshi",
          "author_url": "",
          "post_date": "01/26/2023 09:47:03",
          "content": "<p>We worked in the Feedback2 and we got the gold. He shared his work in that competition, very clear.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 2122356,
          "author_name": "bakeryproducts",
          "author_url": "",
          "post_date": "01/30/2023 21:49:34",
          "content": "<p><a href=\"https://www.kaggle.com/onodera\" target=\"_blank\">@onodera</a> it looks like he was removed from Santander competition</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2115949,
      "author_name": "nikhilmishradev",
      "author_url": "",
      "post_date": "01/26/2023 04:56:06",
      "content": "<p>I was contacted by RunningZ and a other top gold solution guy separately currently in this competition, even before they submitted, just a few days back. They must be really pros to contact for team up even before making a sub. I am happy I did not team up.</p>\n<p>Also I really appreciate Bruce for openly raising the serious issue, even though it affects your team's chances in this competition.</p>\n<p>A jump from calculation 0.597 to 0.603 is fantastic, that of a superhuman, unless you already have some subs from the 0.6+ range already with you, question is from where did he get it ?</p>",
      "votes": null,
      "replies": [
        {
          "id": 2117423,
          "author_name": "cpmpml",
          "author_url": "",
          "post_date": "01/27/2023 09:08:09",
          "content": "<p>Some past top kagglers maintained their status for way too long by doing just that: contacting top LB teams and joining them late in every compeittion. It does not make them cheaters still. Here is seems worse than that.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2115979,
      "author_name": "sirius81",
      "author_url": "",
      "post_date": "01/26/2023 05:24:54",
      "content": "<p>Thank you very much, Bruce!</p>\n<p>It was me that emailed Bruce to pay attention to the details of the submission scoring 0.603 because I found they jumped to top rank just a few hours after my team exchanged the prediction files on slack. </p>\n<p>And someone told me one of Bruce's teammate is related with a man in my team. </p>\n<p>Immediately, I contacted Bruce, a trusted teacher, to take a check on that. </p>\n<p>Until now, things are very suspicious. But I think we could verify something by a detailed check.</p>\n<p>I love kaggle. Hope everyone is clean and I am just mistaken to have the suspect and there are no more bad influence. </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2116028,
      "author_name": "gunesevitan",
      "author_url": "",
      "post_date": "01/26/2023 06:20:54",
      "content": "<p>Thanks for sharing this <a href=\"https://www.kaggle.com/bruceqdu\" target=\"_blank\">@bruceqdu</a> even though it might jeopardize your team's result. I hope your and Konstantin's team won't be affected.</p>",
      "votes": null,
      "replies": [
        {
          "id": 2116031,
          "author_name": "nikhilmishradev",
          "author_url": "",
          "post_date": "01/26/2023 06:24:12",
          "content": "<p>I wished they had some way to stop affecting the honest kagglers who are affected by fraudsters in their team. But this is unfair to other people in the gold zone, as the best submissions of the alleged teams contains high scoring solutions, which are not completely their own</p>",
          "votes": null,
          "replies": [
            {
              "id": 2116042,
              "author_name": "gunesevitan",
              "author_url": "",
              "post_date": "01/26/2023 06:35:18",
              "content": "<p>You are right but clearly those two teams show their true intentions. They are trying to cooperate by excluding the cheaters. I think we can trust them for not using cheaters' submissions. However cheaters can still sabotage the teams by using all of their submissions. A majority vote to kick someone from a team can be useful in those cases like in CSGO.</p>",
              "votes": null,
              "replies": [
                {
                  "id": 2116045,
                  "author_name": "nikhilmishradev",
                  "author_url": "",
                  "post_date": "01/26/2023 06:38:58",
                  "content": "<p>yes, the biggest problem is sabotaging. Also a cheater can easily download a submission from the submissions tab, and share with the other cheater in some other team. The other cheater can do the same. True csgo like implementation would be helpful :D</p>",
                  "votes": null,
                  "replies": []
                }
              ]
            }
          ]
        }
      ]
    },
    {
      "id": 2116036,
      "author_name": "hydantess",
      "author_url": "",
      "post_date": "01/26/2023 06:29:30",
      "content": "<p>These things happened again and again in last year. <br>\nIt's really good to point it out especially as a teammate.</p>",
      "votes": null,
      "replies": [
        {
          "id": 2116198,
          "author_name": "philippsinger",
          "author_url": "",
          "post_date": "01/26/2023 09:51:55",
          "content": "<p>Yes, it is very important and honest to point such things out as teammates, even if it might hurt yourself in the short-term, but it will keep your own conscience clean. I strongly believe that honesty always wins in the long-term.</p>\n<p>Otherwise others will potentially never know about it. Maybe Kaggle needs a rating system for teammembers. It is very difficult for newcomers to find honest teammates, but even hard for veterans.</p>",
          "votes": null,
          "replies": [
            {
              "id": 2116247,
              "author_name": "hydantess",
              "author_url": "",
              "post_date": "01/26/2023 10:50:13",
              "content": "<p>Totally agree. I can't sleep if my gold medals are unclean. <br>\nWe are all data scientists and I know many of us already suspect them for long time but have no evidence.<br>\nSo I am really happy that bruce can point it out.</p>",
              "votes": null,
              "replies": [
                {
                  "id": 2116510,
                  "author_name": "nasere",
                  "author_url": "",
                  "post_date": "01/26/2023 14:43:33",
                  "content": "<p>Honesty is Golden.</p>",
                  "votes": null,
                  "replies": []
                }
              ]
            },
            {
              "id": 2116770,
              "author_name": "hengck23",
              "author_url": "",
              "post_date": "01/26/2023 17:57:12",
              "content": "<p>\"Maybe Kaggle needs a rating system for teammembers.\"</p>\n<p>Before teaming up, team leader can request candidate to prove that his work is genuine through the below proposed kaggle verification service:</p>\n<p>This works the same as code requirement competition:</p>\n<ol>\n<li>candidate create a notebook </li>\n<li>candidate need to submit code and make prediction on the test data</li>\n<li>the sever compares the submission (and code) of the candiate against its database (i.e. submissions of other candidate) and check for abnormality. </li>\n<li>if everything is normal, a certificate is issued.</li>\n</ol>\n<p>based on the cerficate, the team leader can decide if he wants to accept the candidate into the team.</p>\n<p>the problem is how to detect abnormality? if kaggle cheater detection is good, then the issue is solved. else, someone needs to develope  cheater detection.</p>\n<p>alternative, we need some hidden data for step.2. or some special data that can detect cheater</p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 2116221,
      "author_name": "snaker",
      "author_url": "",
      "post_date": "01/26/2023 10:10:52",
      "content": "<p>It's very cool and brave of you to clarify this even if this has a chance to cancel the score of your team.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2116606,
      "author_name": "duykhanh99",
      "author_url": "",
      "post_date": "01/26/2023 15:44:56",
      "content": "<p>It's a pity for you and the other teammates who worked so hard at this competition. I was also a victim of the same problem as you in the G2Net Gravitational Wave Detection contest and then our private team results were removed (this was expected). Wishing the best for everyone who has worked hard on your team and Kaggle will make decisions that are fairest to all teams!!!</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2116751,
      "author_name": "firenh",
      "author_url": "",
      "post_date": "01/26/2023 17:39:38",
      "content": "<p>Kaggle should help all honest people and ban those cheaters!<br>\nSooooooo many organized cheating can be found in social media like ‘xiaohongshu’. This is just disgusting!<br>\nPretty sure there are much more cheaters, guys, please report if you found any suspicious activities!<br>\nWell done Bruce!</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2117430,
      "author_name": "cpmpml",
      "author_url": "",
      "post_date": "01/27/2023 09:11:05",
      "content": "<p>Besides the sad story for you, this is great to read. I hope Kaggle will enforce you suggestion that every gold medal code should be made public. I didn't do it consistently in the past but I would if this is the rule from now.</p>\n<p>I once was disqualified because we (Giba and I) teamed we someone who cheated (he used 3 accounts). We were in gold in private lB before being removed. I can understand how you might feel. </p>",
      "votes": null,
      "replies": [
        {
          "id": 2117664,
          "author_name": "bruceqdu",
          "author_url": "",
          "post_date": "01/27/2023 12:30:43",
          "content": "<p>Yes. It indeed had a bad influence on our passion and motivation to continue the competition. <br>\nActually, I don't need a medal to prove myself. One main reason I participated in this competition is to prepare materials for the next semester's course. And now the first lesson will be honesty and rules.<br>\nAdditionally, I wish kaggle could give Konstantin Gavrilchik and Ilya losthe the medals they deserve. </p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2117813,
      "author_name": "joyce903",
      "author_url": "",
      "post_date": "01/27/2023 15:08:25",
      "content": "<p><a href=\"https://www.kaggle.com/bruceqdu\" target=\"_blank\">@bruceqdu</a> , You are the pride of kagglers ✔️</p>",
      "votes": null,
      "replies": [
        {
          "id": 2118523,
          "author_name": "trudaapp",
          "author_url": "",
          "post_date": "01/28/2023 04:28:01",
          "content": "<p>Couldn't agree more☝️</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2117983,
      "author_name": "sunny9999",
      "author_url": "",
      "post_date": "01/27/2023 17:27:12",
      "content": "<p>thank you for sharing</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2118746,
      "author_name": "yidalin",
      "author_url": "",
      "post_date": "01/28/2023 08:38:28",
      "content": "<p>As a student, I can't find a team to play games with, and the results of playing games by myself are not very ideal. I would like to ask how to find a suitable team?🎶</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2119067,
      "author_name": "crodoc",
      "author_url": "",
      "post_date": "01/28/2023 13:33:46",
      "content": "<p>Thanks for being honest about everything. I hope you don't get discouraged by all of this.</p>\n<p>I can't imagine how you feel, but a lot of us know the feeling of working super hard and getting slapped in the face at the end. Mostly due to shake up, so I imagine this must feel even worse.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2123678,
      "author_name": "gunesevitan",
      "author_url": "",
      "post_date": "01/31/2023 16:23:19",
      "content": "<p>When I first started Kaggle, Santander Customer Transaction was around. I remember that RunningZ's team was removed on that competition. I think this incident is going on for years now. He also changed his bio from Master at BUAA to Master at Kaggle couple days ago like poteman removed his name from his repo. They are trying so hard not get IDed.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2124805,
      "author_name": "evilpsycho42",
      "author_url": "",
      "post_date": "02/01/2023 08:15:01",
      "content": "<p>Thank you for posting these details, a small group of people are hurting the community and we need to resist them.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2126717,
      "author_name": "rahultriv5",
      "author_url": "",
      "post_date": "02/02/2023 12:13:34",
      "content": "<p>Thanks for the details.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2127816,
      "author_name": "wochidadonggua",
      "author_url": "",
      "post_date": "02/03/2023 07:53:40",
      "content": "<p>coming from another  thread</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2170805,
      "author_name": "chg0901",
      "author_url": "",
      "post_date": "03/06/2023 09:44:39",
      "content": "<p>I was shocked when I heard this things happens. hope this won't happen agian. Thank you for your brave. wishing you could get better results in next competition! </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3007539,
      "author_name": "tinkerturbo",
      "author_url": "",
      "post_date": "10/05/2024 14:07:56",
      "content": "<p>You can never make a good deal with a bad person.<br>\nSimple solution: Do not add an unknown teammate if you do not accept the worst-case scenario. </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3007544,
      "author_name": "tinkerturbo",
      "author_url": "",
      "post_date": "10/05/2024 14:11:03",
      "content": "<p>Btw, I read many were shocked, this is normal human behavior. <br>\nOn the contrary, having high-grade ethics is the abnormal.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2115939": "I and my student lily participated in this completion about one month ago and achieved 0.597 score about 5 days ago. RunningZ contacted me by WeChat on January 21, 2023, and wanted to join our team. I knew him in KDD CUP 2020, which is also a recommendation system competition (KDD Cup 2020 Challenges for Modern E-Commerce Platform: Debiasing). He was a team leader and ranked 3rd finally. I was another team leader and ranked 6th. I think we could get a better score after he joins our team, and invited him and shared him with our codes.\nOn January 24, he submitted an ensemble submission and achieved an excellent score (0.601). I was shocked by the ensemble, and he just said he did voting, weighting and stacking based on our previous submissions and our codes. Then, he let me make him as leader and contacted other competitors to merge teams. Finally, Konstantin Gavrilchik and Ilya los agreed to join our team. Konstantin Gavrilchik created a Slack channel to share solutions and discuss problems. \nOn January 25, RunningZ contacted me by WeChat and let me share our solution and let me say our best single model achieved 0.599 score, which is something weird. I briefly introduced our solution and claimed that our best single model is 0.597 and the ensemble solution by RunningZ can achieve 0.603. However, I don’t know exactly how he did it. After that, I asked him by WeChat and wanted him to provide the ensemble code with me, but he said his code was messy and let me continue to give him results of single models. Actually, although I have achieved top ranks in several recommendation system competitions, I haven’t tried the ensemble method to vote on multiple submissions, which may be useful to improve performance. \nAfter a few hours, I checked my email and found someone told me I should focus on the ensemble pipeline by RunningZ, and I talked to RunningZ by  WeChat. He promised to share his code with team members in the evening. The ensemble performance also surprises Konstantin Gavrilchik and Ilya los. However, RunningZ has not reproduced the submission and provided his codes until now. And he was inconsistent in his words in the chat history of WeChat and Slack.\nWe wish Kaggle could handle this matter. And a suggestion (https://www.kaggle.com/competitions/otto-recommender-system/discussion/380783#2115469) may be useful to team up in Kaggle competitions. Code verification is also necessary for gold solutions, and the solutions should be posted on github. My students and I always did this, such as CIKM AnalytiCup 2019 (https://github.com/ChuanyuXue/CIKM-2019-AnalytiCup), KDD CUP 2020 (https://github.com/ChuanyuXue/KDDCUP-2020) and WSDM CUP 2022 (https://github.com/hansu1017/WSDM-CUP-2022-Retention-Score-Prediction). Eventually, I am very sorry to have involved Konstantin Gavrilchik and Ilya los in this accident.",
    "2115945": "Thank you for the raising this issue. The next questions are \n- How did RunningZ get that score?\n- If this is the cheating, is this first time for him?",
    "2115949": "I was contacted by RunningZ and a other top gold solution guy separately currently in this competition, even before they submitted, just a few days back. They must be really pros to contact for team up even before making a sub. I am happy I did not team up.\n\nAlso I really appreciate Bruce for openly raising the serious issue, even though it affects your team's chances in this competition.\n\nA jump from calculation 0.597 to 0.603 is fantastic, that of a superhuman, unless you already have some subs from the 0.6+ range already with you, question is from where did he get it ?",
    "2115979": "Thank you very much, Bruce!\n\nIt was me that emailed Bruce to pay attention to the details of the submission scoring 0.603 because I found they jumped to top rank just a few hours after my team exchanged the prediction files on slack. \n\nAnd someone told me one of Bruce's teammate is related with a man in my team. \n\nImmediately, I contacted Bruce, a trusted teacher, to take a check on that. \n\nUntil now, things are very suspicious. But I think we could verify something by a detailed check.\n\nI love kaggle. Hope everyone is clean and I am just mistaken to have the suspect and there are no more bad influence.",
    "2116020": "Obviously not his first time. I saw those two people appearing in gold zone during last weeks of competitions at least 10 times.",
    "2116028": "Thanks for sharing this @bruceqdu even though it might jeopardize your team's result. I hope your and Konstantin's team won't be affected.",
    "2116031": "I wished they had some way to stop affecting the honest kagglers who are affected by fraudsters in their team. But this is unfair to other people in the gold zone, as the best submissions of the alleged teams contains high scoring solutions, which are not completely their own",
    "2116036": "These things happened again and again in last year. \nIt's really good to point it out especially as a teammate.",
    "2116042": "You are right but clearly those two teams show their true intentions. They are trying to cooperate by excluding the cheaters. I think we can trust them for not using cheaters' submissions. However cheaters can still sabotage the teams by using all of their submissions. A majority vote to kick someone from a team can be useful in those cases like in CSGO.",
    "2116045": "yes, the biggest problem is sabotaging. Also a cheater can easily download a submission from the submissions tab, and share with the other cheater in some other team. The other cheater can do the same. True csgo like implementation would be helpful :D",
    "2116191": "We worked in the Feedback2 and we got the gold. He shared his work in that competition, very clear.",
    "2116198": "Yes, it is very important and honest to point such things out as teammates, even if it might hurt yourself in the short-term, but it will keep your own conscience clean. I strongly believe that honesty always wins in the long-term.\n\nOtherwise others will potentially never know about it. Maybe Kaggle needs a rating system for teammembers. It is very difficult for newcomers to find honest teammates, but even hard for veterans.",
    "2116221": "It's very cool and brave of you to clarify this even if this has a chance to cancel the score of your team.",
    "2116247": "Totally agree. I can't sleep if my gold medals are unclean. \nWe are all data scientists and I know many of us already suspect them for long time but have no evidence.\nSo I am really happy that bruce can point it out.",
    "2116510": "Honesty is Golden.",
    "2116606": "It's a pity for you and the other teammates who worked so hard at this competition. I was also a victim of the same problem as you in the G2Net Gravitational Wave Detection contest and then our private team results were removed (this was expected). Wishing the best for everyone who has worked hard on your team and Kaggle will make decisions that are fairest to all teams!!!",
    "2116751": "Kaggle should help all honest people and ban those cheaters!\nSooooooo many organized cheating can be found in social media like ‘xiaohongshu’. This is just disgusting!\nPretty sure there are much more cheaters, guys, please report if you found any suspicious activities!\nWell done Bruce!",
    "2116770": "\"Maybe Kaggle needs a rating system for teammembers.\"\n \nBefore teaming up, team leader can request candidate to prove that his work is genuine through the below proposed kaggle verification service:\n\nThis works the same as code requirement competition:\n1. candidate create a notebook \n2. candidate need to submit code and make prediction on the test data\n3. the sever compares the submission (and code) of the candiate against its database (i.e. submissions of other candidate) and check for abnormality. \n4. if everything is normal, a certificate is issued.\n\nbased on the cerficate, the team leader can decide if he wants to accept the candidate into the team.\n\nthe problem is how to detect abnormality? if kaggle cheater detection is good, then the issue is solved. else, someone needs to develope  cheater detection.\n\nalternative, we need some hidden data for step.2. or some special data that can detect cheater",
    "2117423": "Some past top kagglers maintained their status for way too long by doing just that: contacting top LB teams and joining them late in every compeittion. It does not make them cheaters still. Here is seems worse than that.",
    "2117430": "Besides the sad story for you, this is great to read. I hope Kaggle will enforce you suggestion that every gold medal code should be made public. I didn't do it consistently in the past but I would if this is the rule from now.\n\nI once was disqualified because we (Giba and I) teamed we someone who cheated (he used 3 accounts). We were in gold in private lB before being removed. I can understand how you might feel.",
    "2117664": "Yes. It indeed had a bad influence on our passion and motivation to continue the competition. \nActually, I don't need a medal to prove myself. One main reason I participated in this competition is to prepare materials for the next semester's course. And now the first lesson will be honesty and rules.\nAdditionally, I wish kaggle could give Konstantin Gavrilchik and Ilya losthe the medals they deserve.",
    "2117813": "bruceqdu , You are the pride of kagglers ✔️",
    "2117983": "thank you for sharing",
    "2118523": "Couldn't agree more☝️",
    "2118746": "As a student, I can't find a team to play games with, and the results of playing games by myself are not very ideal. I would like to ask how to find a suitable team?🎶",
    "2119067": "Thanks for being honest about everything. I hope you don't get discouraged by all of this.\n\nI can't imagine how you feel, but a lot of us know the feeling of working super hard and getting slapped in the face at the end. Mostly due to shake up, so I imagine this must feel even worse.",
    "2122356": "onodera it looks like he was removed from Santander competition",
    "2123678": "When I first started Kaggle, Santander Customer Transaction was around. I remember that RunningZ's team was removed on that competition. I think this incident is going on for years now. He also changed his bio from Master at BUAA to Master at Kaggle couple days ago like poteman removed his name from his repo. They are trying so hard not get IDed.",
    "2124805": "Thank you for posting these details, a small group of people are hurting the community and we need to resist them.",
    "2126717": "Thanks for the details.",
    "2127816": "coming from another  thread",
    "2170805": "I was shocked when I heard this things happens. hope this won't happen agian. Thank you for your brave. wishing you could get better results in next competition!",
    "3007539": "You can never make a good deal with a bad person.\nSimple solution: Do not add an unknown teammate if you do not accept the worst-case scenario.",
    "3007544": "Btw, I read many were shocked, this is normal human behavior. \nOn the contrary, having high-grade ethics is the abnormal."
  },
  "source": "meta"
}