{
  "id": 146089,
  "title": "Data integrity issue with Massey Ordinals for 2020",
  "url": "/competitions/march-madness-analytics-2020/discussion/146089",
  "author_name": "",
  "post_date": "2020-04-25T20:05:57.574564100Z",
  "votes": 1,
  "comment_count": 3,
  "views": 0,
  "content": "<p>In the Massey Ordinal's file, MNCAATourneySeeds, for Season 2020, team 1115 I found three OrdinalRanks for the RankingDayNum of 128 for SystemName WLK...rankings 48, 216, 348.\nLooking at just that team for just that system, there are three  records for every RankingDayNun for all of 2020.</p>\n\n<p>I'm also seeing dups for teams 1168,1204,1206,1247,1389,1413,1427 for 2020 for WLK. 1115 is the only team in triplicate. The others are duplicated and probably for every week although I didn't verify. </p>\n\n<p>Hopefully this can be fixed quickly. </p>\n\n<p>Thanks\nBen</p>",
  "messages": [
    {
      "id": "820947",
      "postDate": "04/25/2020 20:05:57",
      "content": "<p>In the Massey Ordinal's file, MNCAATourneySeeds, for Season 2020, team 1115 I found three OrdinalRanks for the RankingDayNum of 128 for SystemName WLK...rankings 48, 216, 348.\nLooking at just that team for just that system, there are three  records for every RankingDayNun for all of 2020.</p>\n\n<p>I'm also seeing dups for teams 1168,1204,1206,1247,1389,1413,1427 for 2020 for WLK. 1115 is the only team in triplicate. The others are duplicated and probably for every week although I didn't verify. </p>\n\n<p>Hopefully this can be fixed quickly. </p>\n\n<p>Thanks\nBen</p>",
      "rawMarkdown": "In the Massey Ordinal's file, MNCAATourneySeeds, for Season 2020, team 1115 I found three OrdinalRanks for the RankingDayNum of 128 for SystemName WLK...rankings 48, 216, 348.\nLooking at just that team for just that system, there are three  records for every RankingDayNun for all of 2020.\n\nI'm also seeing dups for teams 1168,1204,1206,1247,1389,1413,1427 for 2020 for WLK. 1115 is the only team in triplicate. The others are duplicated and probably for every week although I didn't verify. \n\nHopefully this can be fixed quickly. \n\nThanks\nBen",
      "votes": null
    },
    {
      "id": "821265",
      "postDate": "04/26/2020 04:08:59",
      "content": "<p>It looks like it is a problem in my mapping of team names from the original Massey Ordinals source.</p>\n\n<p>There are 9 teams that are not currently listed in the 2020 Massey Ordinals:\n1116: Arkansas\n1117: Arkansas St\n1143: California\n1205: Gardner Webb\n1207: Georgetown\n1248: Lafayette\n1390: Stanford\n1416: UCF\n1428: Utah</p>\n\n<p>And there are 7 teams that are double-counted in the 2020 Massey Ordinals:\n1168: CS Fullerton\n1204: Ga Southern\n1206: George Mason\n1247: La Salle\n1389: St Peter's\n1413: UC Davis\n1427: UT San Antonio</p>\n\n<p>And there is one team that is triple-counted in the 2020 Massey Ordinals:\n1115: Ark Pine Bluff</p>\n\n<p>So I think that for example it is reading the team names from Arkansas, Arkansas St, and Ark Pine Bluff, and mapping all three of them to the Ark Pine Bluff team (ID=1115) rather than mapping them correctly into the three distinct teams.  Or it's seeing both California and CS Fullerton and mapping them both to CS Fullerton, etc.  It does an Excel lookup and probably isn't handling the exact match logic correctly if the spelling in the original Massey source is an unknown team name spelling.</p>\n\n<p>Unfortunately this year the Massey Composite Page that I normally use for collecting the Massey Ordinals did not have the usual archive pages available, so I had to pull them a different way and I guess I didn't get it all right the first time.  Also I can usually cross-check the high-ranking teams against the tourney seeds, to look for mapping problems, but there were no tourney seeds this year.  In any event, I will dive back into this shortly and try to resolve it.</p>",
      "rawMarkdown": "It looks like it is a problem in my mapping of team names from the original Massey Ordinals source.\n\nThere are 9 teams that are not currently listed in the 2020 Massey Ordinals:\n1116: Arkansas\n1117: Arkansas St\n1143: California\n1205: Gardner Webb\n1207: Georgetown\n1248: Lafayette\n1390: Stanford\n1416: UCF\n1428: Utah\n\nAnd there are 7 teams that are double-counted in the 2020 Massey Ordinals:\n1168: CS Fullerton\n1204: Ga Southern\n1206: George Mason\n1247: La Salle\n1389: St Peter's\n1413: UC Davis\n1427: UT San Antonio\n\nAnd there is one team that is triple-counted in the 2020 Massey Ordinals:\n1115: Ark Pine Bluff\n\nSo I think that for example it is reading the team names from Arkansas, Arkansas St, and Ark Pine Bluff, and mapping all three of them to the Ark Pine Bluff team (ID=1115) rather than mapping them correctly into the three distinct teams.  Or it's seeing both California and CS Fullerton and mapping them both to CS Fullerton, etc.  It does an Excel lookup and probably isn't handling the exact match logic correctly if the spelling in the original Massey source is an unknown team name spelling.\n\nUnfortunately this year the Massey Composite Page that I normally use for collecting the Massey Ordinals did not have the usual archive pages available, so I had to pull them a different way and I guess I didn't get it all right the first time.  Also I can usually cross-check the high-ranking teams against the tourney seeds, to look for mapping problems, but there were no tourney seeds this year.  In any event, I will dive back into this shortly and try to resolve it.",
      "votes": null
    },
    {
      "id": "821335",
      "postDate": "04/26/2020 05:13:44",
      "content": "<p>Here is a corrected Massey Ordinals data file for the 2020 Season.  The only changes should involve those 17 teams listed below - the \"not currently listed\" teams should be in there now, and the \"double-counted\" and \"triple-counted\" teams should be in there only once per day/system, rather than being in there 2 or 3 times per.</p>",
      "rawMarkdown": "Here is a corrected Massey Ordinals data file for the 2020 Season.  The only changes should involve those 17 teams listed below - the \"not currently listed\" teams should be in there now, and the \"double-counted\" and \"triple-counted\" teams should be in there only once per day/system, rather than being in there 2 or 3 times per.",
      "votes": null
    },
    {
      "id": "822082",
      "postDate": "04/26/2020 16:45:02",
      "content": "<p>Thanks for pulling this together so quickly. I didn't think I'd see anything until tomorrow or Tuesday. </p>",
      "rawMarkdown": "Thanks for pulling this together so quickly. I didn't think I'd see anything until tomorrow or Tuesday.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 821265,
      "author_name": "jeffsonas",
      "author_url": "",
      "post_date": "04/26/2020 04:08:59",
      "content": "<p>It looks like it is a problem in my mapping of team names from the original Massey Ordinals source.</p>\n\n<p>There are 9 teams that are not currently listed in the 2020 Massey Ordinals:\n1116: Arkansas\n1117: Arkansas St\n1143: California\n1205: Gardner Webb\n1207: Georgetown\n1248: Lafayette\n1390: Stanford\n1416: UCF\n1428: Utah</p>\n\n<p>And there are 7 teams that are double-counted in the 2020 Massey Ordinals:\n1168: CS Fullerton\n1204: Ga Southern\n1206: George Mason\n1247: La Salle\n1389: St Peter's\n1413: UC Davis\n1427: UT San Antonio</p>\n\n<p>And there is one team that is triple-counted in the 2020 Massey Ordinals:\n1115: Ark Pine Bluff</p>\n\n<p>So I think that for example it is reading the team names from Arkansas, Arkansas St, and Ark Pine Bluff, and mapping all three of them to the Ark Pine Bluff team (ID=1115) rather than mapping them correctly into the three distinct teams.  Or it's seeing both California and CS Fullerton and mapping them both to CS Fullerton, etc.  It does an Excel lookup and probably isn't handling the exact match logic correctly if the spelling in the original Massey source is an unknown team name spelling.</p>\n\n<p>Unfortunately this year the Massey Composite Page that I normally use for collecting the Massey Ordinals did not have the usual archive pages available, so I had to pull them a different way and I guess I didn't get it all right the first time.  Also I can usually cross-check the high-ranking teams against the tourney seeds, to look for mapping problems, but there were no tourney seeds this year.  In any event, I will dive back into this shortly and try to resolve it.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 821335,
      "author_name": "jeffsonas",
      "author_url": "",
      "post_date": "04/26/2020 05:13:44",
      "content": "<p>Here is a corrected Massey Ordinals data file for the 2020 Season.  The only changes should involve those 17 teams listed below - the \"not currently listed\" teams should be in there now, and the \"double-counted\" and \"triple-counted\" teams should be in there only once per day/system, rather than being in there 2 or 3 times per.</p>",
      "votes": null,
      "replies": [
        {
          "id": 822082,
          "author_name": "btesch",
          "author_url": "",
          "post_date": "04/26/2020 16:45:02",
          "content": "<p>Thanks for pulling this together so quickly. I didn't think I'd see anything until tomorrow or Tuesday. </p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "820947": "In the Massey Ordinal's file, MNCAATourneySeeds, for Season 2020, team 1115 I found three OrdinalRanks for the RankingDayNum of 128 for SystemName WLK...rankings 48, 216, 348.\nLooking at just that team for just that system, there are three  records for every RankingDayNun for all of 2020.\n\nI'm also seeing dups for teams 1168,1204,1206,1247,1389,1413,1427 for 2020 for WLK. 1115 is the only team in triplicate. The others are duplicated and probably for every week although I didn't verify. \n\nHopefully this can be fixed quickly. \n\nThanks\nBen",
    "821265": "It looks like it is a problem in my mapping of team names from the original Massey Ordinals source.\n\nThere are 9 teams that are not currently listed in the 2020 Massey Ordinals:\n1116: Arkansas\n1117: Arkansas St\n1143: California\n1205: Gardner Webb\n1207: Georgetown\n1248: Lafayette\n1390: Stanford\n1416: UCF\n1428: Utah\n\nAnd there are 7 teams that are double-counted in the 2020 Massey Ordinals:\n1168: CS Fullerton\n1204: Ga Southern\n1206: George Mason\n1247: La Salle\n1389: St Peter's\n1413: UC Davis\n1427: UT San Antonio\n\nAnd there is one team that is triple-counted in the 2020 Massey Ordinals:\n1115: Ark Pine Bluff\n\nSo I think that for example it is reading the team names from Arkansas, Arkansas St, and Ark Pine Bluff, and mapping all three of them to the Ark Pine Bluff team (ID=1115) rather than mapping them correctly into the three distinct teams.  Or it's seeing both California and CS Fullerton and mapping them both to CS Fullerton, etc.  It does an Excel lookup and probably isn't handling the exact match logic correctly if the spelling in the original Massey source is an unknown team name spelling.\n\nUnfortunately this year the Massey Composite Page that I normally use for collecting the Massey Ordinals did not have the usual archive pages available, so I had to pull them a different way and I guess I didn't get it all right the first time.  Also I can usually cross-check the high-ranking teams against the tourney seeds, to look for mapping problems, but there were no tourney seeds this year.  In any event, I will dive back into this shortly and try to resolve it.",
    "821335": "Here is a corrected Massey Ordinals data file for the 2020 Season.  The only changes should involve those 17 teams listed below - the \"not currently listed\" teams should be in there now, and the \"double-counted\" and \"triple-counted\" teams should be in there only once per day/system, rather than being in there 2 or 3 times per.",
    "822082": "Thanks for pulling this together so quickly. I didn't think I'd see anything until tomorrow or Tuesday."
  },
  "source": "meta"
}