{
  "id": 245328,
  "title": "One stop shop for external MLB Datasets",
  "url": "/competitions/mlb-player-digital-engagement-forecasting/discussion/245328",
  "author_name": "",
  "post_date": "2021-06-10T15:47:39.343652500Z",
  "votes": 16,
  "comment_count": 8,
  "views": 0,
  "content": "<p>This discussion will be collection of all external datasets on Kaggle and other sources linked below.</p>\n<p>These datasets can be used for EDA as well as competition submission according to competition rules.</p>\n<blockquote>\n  <p>Freely &amp; publicly available external data is allowed, including pre-trained models</p>\n</blockquote>\n<ol>\n<li><a href=\"https://www.kaggle.com/pschale/mlb-pitch-data-20152018\" target=\"_blank\">MLB Pitch Data 2015-2018</a></li>\n<li><a href=\"https://data.world/dataquest/mlb-game-logs\" target=\"_blank\">MLB Game Logs 1871-2016</a></li>\n<li><a href=\"https://data.world/graphhopper/mlb-diversity-1903-1946\" target=\"_blank\">MLB Diversity 1903 - 1946</a></li>\n<li><a href=\"https://www.kaggle.com/open-source-sports/baseball-databank\" target=\"_blank\">Baseball Data Bank</a></li>\n<li><a href=\"https://www.kaggle.com/sportradar/baseball\" target=\"_blank\">SportRadar Baseball</a></li>\n<li><a href=\"https://www.kaggle.com/seanlahman/the-history-of-baseball\" target=\"_blank\">The History of Baseball</a></li>\n<li><a href=\"http://www.seanlahman.com/baseball-archive/statistics\" target=\"_blank\">Lahman's Baseball Dataset</a> | Thanks <a href=\"https://www.kaggle.com/josephvm\" target=\"_blank\">@josephvm</a></li>\n<li><a href=\"https://www.retrosheet.org/\" target=\"_blank\">Retrosheet Data</a>  | Thanks <a href=\"https://www.kaggle.com/josephvm\" target=\"_blank\">@josephvm</a></li>\n</ol>\n<h3>Past Competitions</h3>\n<ol>\n<li><a href=\"https://www.kaggle.com/c/march-machine-learning-mania-2014/data\" target=\"_blank\">March Machine Learning Mania</a></li>\n</ol>\n<h3>New sources</h3>\n<ol>\n<li><a href=\"https://www.kaggle.com/mlandry/mlbscheduleformattedfordigitalengagement\" target=\"_blank\">MLB 2021 schedule</a>  | Thanks <a href=\"https://www.kaggle.com/mlandry\" target=\"_blank\">@mlandry</a></li>\n</ol>",
  "messages": [
    {
      "id": "1344077",
      "postDate": "06/10/2021 15:47:39",
      "content": "<p>This discussion will be collection of all external datasets on Kaggle and other sources linked below.</p>\n<p>These datasets can be used for EDA as well as competition submission according to competition rules.</p>\n<blockquote>\n  <p>Freely &amp; publicly available external data is allowed, including pre-trained models</p>\n</blockquote>\n<ol>\n<li><a href=\"https://www.kaggle.com/pschale/mlb-pitch-data-20152018\" target=\"_blank\">MLB Pitch Data 2015-2018</a></li>\n<li><a href=\"https://data.world/dataquest/mlb-game-logs\" target=\"_blank\">MLB Game Logs 1871-2016</a></li>\n<li><a href=\"https://data.world/graphhopper/mlb-diversity-1903-1946\" target=\"_blank\">MLB Diversity 1903 - 1946</a></li>\n<li><a href=\"https://www.kaggle.com/open-source-sports/baseball-databank\" target=\"_blank\">Baseball Data Bank</a></li>\n<li><a href=\"https://www.kaggle.com/sportradar/baseball\" target=\"_blank\">SportRadar Baseball</a></li>\n<li><a href=\"https://www.kaggle.com/seanlahman/the-history-of-baseball\" target=\"_blank\">The History of Baseball</a></li>\n<li><a href=\"http://www.seanlahman.com/baseball-archive/statistics\" target=\"_blank\">Lahman's Baseball Dataset</a> | Thanks <a href=\"https://www.kaggle.com/josephvm\" target=\"_blank\">@josephvm</a></li>\n<li><a href=\"https://www.retrosheet.org/\" target=\"_blank\">Retrosheet Data</a>  | Thanks <a href=\"https://www.kaggle.com/josephvm\" target=\"_blank\">@josephvm</a></li>\n</ol>\n<h3>Past Competitions</h3>\n<ol>\n<li><a href=\"https://www.kaggle.com/c/march-machine-learning-mania-2014/data\" target=\"_blank\">March Machine Learning Mania</a></li>\n</ol>\n<h3>New sources</h3>\n<ol>\n<li><a href=\"https://www.kaggle.com/mlandry/mlbscheduleformattedfordigitalengagement\" target=\"_blank\">MLB 2021 schedule</a>  | Thanks <a href=\"https://www.kaggle.com/mlandry\" target=\"_blank\">@mlandry</a></li>\n</ol>",
      "rawMarkdown": "This discussion will be collection of all external datasets on Kaggle and other sources linked below.\n\nThese datasets can be used for EDA as well as competition submission according to competition rules.\n> Freely & publicly available external data is allowed, including pre-trained models\n\n1. [MLB Pitch Data 2015-2018](https://www.kaggle.com/pschale/mlb-pitch-data-20152018)\n2. [MLB Game Logs 1871-2016](https://data.world/dataquest/mlb-game-logs)\n3. [MLB Diversity 1903 - 1946](https://data.world/graphhopper/mlb-diversity-1903-1946)\n4. [Baseball Data Bank](https://www.kaggle.com/open-source-sports/baseball-databank)\n5. [SportRadar Baseball](https://www.kaggle.com/sportradar/baseball)\n6. [The History of Baseball](https://www.kaggle.com/seanlahman/the-history-of-baseball)\n6. [Lahman's Baseball Dataset](http://www.seanlahman.com/baseball-archive/statistics) | Thanks @josephvm\n7. [Retrosheet Data](https://www.retrosheet.org/)  | Thanks @josephvm\n\n\n### Past Competitions\n1. [March Machine Learning Mania](https://www.kaggle.com/c/march-machine-learning-mania-2014/data)\n\n### New sources\n1.  [MLB 2021 schedule](https://www.kaggle.com/mlandry/mlbscheduleformattedfordigitalengagement)  | Thanks @mlandry",
      "votes": null
    },
    {
      "id": "1344223",
      "postDate": "06/10/2021 17:47:42",
      "content": "<p><a href=\"http://www.seanlahman.com/baseball-archive/statistics\" target=\"_blank\">Lahman's Database</a> and <a href=\"https://www.retrosheet.org/\" target=\"_blank\">Retrosheet</a> have a lot of great data as well. Lahman's Database has yearly data for over 100 years and Retrosheet also has play-by-play data. Looking at the data given for this competition, one new piece of information that Lahman's Database has is what college players went to. Looks like Baseball Data Bank is an older version of Lahman's Database as well.  </p>\n<p>Hope those help someone and thanks for making this list!</p>",
      "rawMarkdown": "[Lahman's Database](http://www.seanlahman.com/baseball-archive/statistics) and [Retrosheet](https://www.retrosheet.org/) have a lot of great data as well. Lahman's Database has yearly data for over 100 years and Retrosheet also has play-by-play data. Looking at the data given for this competition, one new piece of information that Lahman's Database has is what college players went to. Looks like Baseball Data Bank is an older version of Lahman's Database as well.  \n\nHope those help someone and thanks for making this list!",
      "votes": null
    },
    {
      "id": "1344226",
      "postDate": "06/10/2021 17:50:53",
      "content": "<p>Thanks for this. Added them to list.</p>",
      "rawMarkdown": "Thanks for this. Added them to list.",
      "votes": null
    },
    {
      "id": "1346914",
      "postDate": "06/12/2021 18:43:57",
      "content": "<p>What I'll find curious is rule changes and their effect on the game. They have been tweaking baseball to speed it up and have changed some aspects. And then you have the Bonds/Sosa era with massive home run numbers. </p>",
      "rawMarkdown": "What I'll find curious is rule changes and their effect on the game. They have been tweaking baseball to speed it up and have changed some aspects. And then you have the Bonds/Sosa era with massive home run numbers.",
      "votes": null
    },
    {
      "id": "1347513",
      "postDate": "06/13/2021 09:36:05",
      "content": "<p>Agree completely, rule changes and market conditions should have more of an increased impact on players. The rule changes [<a href=\"https://www.baseball-almanac.com/rulechng.shtml\" target=\"_blank\">https://www.baseball-almanac.com/rulechng.shtml</a>] don't appear to be regular</p>",
      "rawMarkdown": "Agree completely, rule changes and market conditions should have more of an increased impact on players. The rule changes [https://www.baseball-almanac.com/rulechng.shtml] don't appear to be regular",
      "votes": null
    },
    {
      "id": "1347519",
      "postDate": "06/13/2021 09:41:46",
      "content": "<p>Does the era of free agency rules set a different agenda for players<br>\n<a href=\"https://baseballhall.org/discover/short-stops/free-agency-still-fuels-baseball\" target=\"_blank\">https://baseballhall.org/discover/short-stops/free-agency-still-fuels-baseball</a>. Similar challenges have been faced by players in different sporting professions, whereby owners had all the power. Are max guaranteed contracts the best way to protect the best players? </p>\n<p>Creating a level playing field to encourage fiscal stability could benefit some but not all if the right players become available. Think of triplets across the NFL and NBA. What are the three (N) most important positions to create a dominant franchise to challenge for a world series? Does team location and historic franchise appeal retain players interests the most?</p>",
      "rawMarkdown": "Does the era of free agency rules set a different agenda for players\nhttps://baseballhall.org/discover/short-stops/free-agency-still-fuels-baseball. Similar challenges have been faced by players in different sporting professions, whereby owners had all the power. Are max guaranteed contracts the best way to protect the best players? \n\nCreating a level playing field to encourage fiscal stability could benefit some but not all if the right players become available. Think of triplets across the NFL and NBA. What are the three (N) most important positions to create a dominant franchise to challenge for a world series? Does team location and historic franchise appeal retain players interests the most?",
      "votes": null
    },
    {
      "id": "1372003",
      "postDate": "07/01/2021 10:55:41",
      "content": "<p>Can anyone confirm if we have to announce what external datasets we are using?</p>\n<p>I'm aware of some publicly available data I wish to use in my models. Is it enough it is publicly available or do I have to share the dataset on Kaggle / announce I am using it in the competition forum? </p>\n<p>Edit: The rules seem to state that as long as it is public it is fine:</p>\n<p><em>C. External Data. You may use data other than the Competition Data (“External Data”) to develop and test your Submissions. However, you will ensure the External Data is publicly available and equally accessible to use by all participants of the Competition for purposes of the competition at no cost to the other participants. The ability to use External Data under this Section 7.C (External Data) does not limit your other obligations under these Competition Rules, including but not limited to Section 11 (Winners Obligations).</em></p>",
      "rawMarkdown": "Can anyone confirm if we have to announce what external datasets we are using?\n\nI'm aware of some publicly available data I wish to use in my models. Is it enough it is publicly available or do I have to share the dataset on Kaggle / announce I am using it in the competition forum? \n\n\nEdit: The rules seem to state that as long as it is public it is fine:\n\n*C. External Data. You may use data other than the Competition Data (“External Data”) to develop and test your Submissions. However, you will ensure the External Data is publicly available and equally accessible to use by all participants of the Competition for purposes of the competition at no cost to the other participants. The ability to use External Data under this Section 7.C (External Data) does not limit your other obligations under these Competition Rules, including but not limited to Section 11 (Winners Obligations).*",
      "votes": null
    },
    {
      "id": "1400083",
      "postDate": "07/26/2021 03:18:51",
      "content": "<p>We are using widely available public information, the MLB schedule. It's available in many places, including MLB's site.<br>\nHere is the specific version we are using, to ensure it's freely available: <a href=\"https://www.kaggle.com/mlandry/mlbscheduleformattedfordigitalengagement\" target=\"_blank\">Schedule Data Set</a>. As noted in the description, it hasn't been updated, but that is the one we've been using.</p>",
      "rawMarkdown": "We are using widely available public information, the MLB schedule. It's available in many places, including MLB's site.\nHere is the specific version we are using, to ensure it's freely available: [Schedule Data Set](https://www.kaggle.com/mlandry/mlbscheduleformattedfordigitalengagement). As noted in the description, it hasn't been updated, but that is the one we've been using.",
      "votes": null
    },
    {
      "id": "1400131",
      "postDate": "07/26/2021 04:46:43",
      "content": "<p>Updating the OP. Thanks!</p>",
      "rawMarkdown": "Updating the OP. Thanks!",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1344223,
      "author_name": "josephvm",
      "author_url": "",
      "post_date": "06/10/2021 17:47:42",
      "content": "<p><a href=\"http://www.seanlahman.com/baseball-archive/statistics\" target=\"_blank\">Lahman's Database</a> and <a href=\"https://www.retrosheet.org/\" target=\"_blank\">Retrosheet</a> have a lot of great data as well. Lahman's Database has yearly data for over 100 years and Retrosheet also has play-by-play data. Looking at the data given for this competition, one new piece of information that Lahman's Database has is what college players went to. Looks like Baseball Data Bank is an older version of Lahman's Database as well.  </p>\n<p>Hope those help someone and thanks for making this list!</p>",
      "votes": null,
      "replies": [
        {
          "id": 1344226,
          "author_name": "shaz13",
          "author_url": "",
          "post_date": "06/10/2021 17:50:53",
          "content": "<p>Thanks for this. Added them to list.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1346914,
      "author_name": "crained",
      "author_url": "",
      "post_date": "06/12/2021 18:43:57",
      "content": "<p>What I'll find curious is rule changes and their effect on the game. They have been tweaking baseball to speed it up and have changed some aspects. And then you have the Bonds/Sosa era with massive home run numbers. </p>",
      "votes": null,
      "replies": [
        {
          "id": 1347513,
          "author_name": "datajmcn",
          "author_url": "",
          "post_date": "06/13/2021 09:36:05",
          "content": "<p>Agree completely, rule changes and market conditions should have more of an increased impact on players. The rule changes [<a href=\"https://www.baseball-almanac.com/rulechng.shtml\" target=\"_blank\">https://www.baseball-almanac.com/rulechng.shtml</a>] don't appear to be regular</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1347519,
      "author_name": "datajmcn",
      "author_url": "",
      "post_date": "06/13/2021 09:41:46",
      "content": "<p>Does the era of free agency rules set a different agenda for players<br>\n<a href=\"https://baseballhall.org/discover/short-stops/free-agency-still-fuels-baseball\" target=\"_blank\">https://baseballhall.org/discover/short-stops/free-agency-still-fuels-baseball</a>. Similar challenges have been faced by players in different sporting professions, whereby owners had all the power. Are max guaranteed contracts the best way to protect the best players? </p>\n<p>Creating a level playing field to encourage fiscal stability could benefit some but not all if the right players become available. Think of triplets across the NFL and NBA. What are the three (N) most important positions to create a dominant franchise to challenge for a world series? Does team location and historic franchise appeal retain players interests the most?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1372003,
      "author_name": "fchmiel",
      "author_url": "",
      "post_date": "07/01/2021 10:55:41",
      "content": "<p>Can anyone confirm if we have to announce what external datasets we are using?</p>\n<p>I'm aware of some publicly available data I wish to use in my models. Is it enough it is publicly available or do I have to share the dataset on Kaggle / announce I am using it in the competition forum? </p>\n<p>Edit: The rules seem to state that as long as it is public it is fine:</p>\n<p><em>C. External Data. You may use data other than the Competition Data (“External Data”) to develop and test your Submissions. However, you will ensure the External Data is publicly available and equally accessible to use by all participants of the Competition for purposes of the competition at no cost to the other participants. The ability to use External Data under this Section 7.C (External Data) does not limit your other obligations under these Competition Rules, including but not limited to Section 11 (Winners Obligations).</em></p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1400083,
      "author_name": "mlandry",
      "author_url": "",
      "post_date": "07/26/2021 03:18:51",
      "content": "<p>We are using widely available public information, the MLB schedule. It's available in many places, including MLB's site.<br>\nHere is the specific version we are using, to ensure it's freely available: <a href=\"https://www.kaggle.com/mlandry/mlbscheduleformattedfordigitalengagement\" target=\"_blank\">Schedule Data Set</a>. As noted in the description, it hasn't been updated, but that is the one we've been using.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1400131,
          "author_name": "shaz13",
          "author_url": "",
          "post_date": "07/26/2021 04:46:43",
          "content": "<p>Updating the OP. Thanks!</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1344077": "This discussion will be collection of all external datasets on Kaggle and other sources linked below.\n\nThese datasets can be used for EDA as well as competition submission according to competition rules.\n> Freely & publicly available external data is allowed, including pre-trained models\n\n1. [MLB Pitch Data 2015-2018](https://www.kaggle.com/pschale/mlb-pitch-data-20152018)\n2. [MLB Game Logs 1871-2016](https://data.world/dataquest/mlb-game-logs)\n3. [MLB Diversity 1903 - 1946](https://data.world/graphhopper/mlb-diversity-1903-1946)\n4. [Baseball Data Bank](https://www.kaggle.com/open-source-sports/baseball-databank)\n5. [SportRadar Baseball](https://www.kaggle.com/sportradar/baseball)\n6. [The History of Baseball](https://www.kaggle.com/seanlahman/the-history-of-baseball)\n6. [Lahman's Baseball Dataset](http://www.seanlahman.com/baseball-archive/statistics) | Thanks @josephvm\n7. [Retrosheet Data](https://www.retrosheet.org/)  | Thanks @josephvm\n\n\n### Past Competitions\n1. [March Machine Learning Mania](https://www.kaggle.com/c/march-machine-learning-mania-2014/data)\n\n### New sources\n1.  [MLB 2021 schedule](https://www.kaggle.com/mlandry/mlbscheduleformattedfordigitalengagement)  | Thanks @mlandry",
    "1344223": "[Lahman's Database](http://www.seanlahman.com/baseball-archive/statistics) and [Retrosheet](https://www.retrosheet.org/) have a lot of great data as well. Lahman's Database has yearly data for over 100 years and Retrosheet also has play-by-play data. Looking at the data given for this competition, one new piece of information that Lahman's Database has is what college players went to. Looks like Baseball Data Bank is an older version of Lahman's Database as well.  \n\nHope those help someone and thanks for making this list!",
    "1344226": "Thanks for this. Added them to list.",
    "1346914": "What I'll find curious is rule changes and their effect on the game. They have been tweaking baseball to speed it up and have changed some aspects. And then you have the Bonds/Sosa era with massive home run numbers.",
    "1347513": "Agree completely, rule changes and market conditions should have more of an increased impact on players. The rule changes [https://www.baseball-almanac.com/rulechng.shtml] don't appear to be regular",
    "1347519": "Does the era of free agency rules set a different agenda for players\nhttps://baseballhall.org/discover/short-stops/free-agency-still-fuels-baseball. Similar challenges have been faced by players in different sporting professions, whereby owners had all the power. Are max guaranteed contracts the best way to protect the best players? \n\nCreating a level playing field to encourage fiscal stability could benefit some but not all if the right players become available. Think of triplets across the NFL and NBA. What are the three (N) most important positions to create a dominant franchise to challenge for a world series? Does team location and historic franchise appeal retain players interests the most?",
    "1372003": "Can anyone confirm if we have to announce what external datasets we are using?\n\nI'm aware of some publicly available data I wish to use in my models. Is it enough it is publicly available or do I have to share the dataset on Kaggle / announce I am using it in the competition forum? \n\n\nEdit: The rules seem to state that as long as it is public it is fine:\n\n*C. External Data. You may use data other than the Competition Data (“External Data”) to develop and test your Submissions. However, you will ensure the External Data is publicly available and equally accessible to use by all participants of the Competition for purposes of the competition at no cost to the other participants. The ability to use External Data under this Section 7.C (External Data) does not limit your other obligations under these Competition Rules, including but not limited to Section 11 (Winners Obligations).*",
    "1400083": "We are using widely available public information, the MLB schedule. It's available in many places, including MLB's site.\nHere is the specific version we are using, to ensure it's freely available: [Schedule Data Set](https://www.kaggle.com/mlandry/mlbscheduleformattedfordigitalengagement). As noted in the description, it hasn't been updated, but that is the one we've been using.",
    "1400131": "Updating the OP. Thanks!"
  },
  "source": "meta"
}