{ "id": 45724, "title": "What hardware did you use?", "url": "/competitions/cdiscount-image-classification-challenge/discussion/45724", "author_name": "", "post_date": "2017-12-15T01:25:49.736332100Z", "votes": 16, "comment_count": 16, "views": 0, "content": "

To start:

\n\n
    \n
  1. 32 Gb RAM, 2 x Titan Pascal X for prototyping
    2. \n
  2. 32 Gb RAM, 4 x GTX 1080 Ti for heavy lifting
    3. \n
", "messages": [ { "id": "257836", "postDate": "12/15/2017 01:25:49", "content": "

To start:

\n\n
    \n
  1. 32 Gb RAM, 2 x Titan Pascal X for prototyping
    2. \n
  2. 32 Gb RAM, 4 x GTX 1080 Ti for heavy lifting
    3. \n
", "rawMarkdown": "To start:\n\n 1. 32 Gb RAM, 2 x Titan Pascal X for prototyping\n 2. 32 Gb RAM, 4 x GTX 1080 Ti for heavy lifting", "votes": null }, { "id": "257873", "postDate": "12/15/2017 02:41:08", "content": "
    \n
  1. AMD 1950x, 128G ram, 4xGtx 1080 ti
    2. \n
", "rawMarkdown": "1. AMD 1950x, 128G ram, 4xGtx 1080 ti", "votes": null }, { "id": "257878", "postDate": "12/15/2017 02:46:38", "content": "

Same team as Enhao,

\n\n

64Gb RAM, 2x GTX 1080 Ti

", "rawMarkdown": "Same team as Enhao,\n\n64Gb RAM, 2x GTX 1080 Ti", "votes": null }, { "id": "257882", "postDate": "12/15/2017 02:52:56", "content": "

One GTX1070, 32GB RAM

", "rawMarkdown": "One GTX1070, 32GB RAM", "votes": null }, { "id": "257936", "postDate": "12/15/2017 05:16:13", "content": "

\"4x 1080Ti\" and \"1x pascal titianX\"

", "rawMarkdown": "\"4x 1080Ti\" and \"1x pascal titianX\"", "votes": null }, { "id": "257992", "postDate": "12/15/2017 08:08:53", "content": "", "rawMarkdown": "i7 7700k, 64gb, 2x 1080 (for working and coding)\n \n - i7 6700k, 32gb, 2х Titan X (Maxwell) (headless learning devbox)\n\n \n - i7 5930K, 32gb, 3x 1080Ti (headless learning devbox)\n\n \n - Xeon 2696v3, 64gb, 4x 1080Ti (headless learning devbox)", "votes": null }, { "id": "258148", "postDate": "12/15/2017 16:04:34", "content": "

8 GB RAM, One GTX 1050 Ti

", "rawMarkdown": "8 GB RAM, One GTX 1050 Ti", "votes": null }, { "id": "258166", "postDate": "12/15/2017 16:37:57", "content": "

I have 4 titan XPs. But currently they are in separate machines. I initially bought them for my own research which does not require parallelism. I would like to merge them into one for parallel training.

\n\n

Can you guys with 4 x 1080 Ti build share how to build such a machine? What is the convenient way to add watercooling (open loop)?

", "rawMarkdown": "I have 4 titan XPs. But currently they are in separate machines. I initially bought them for my own research which does not require parallelism. I would like to merge them into one for parallel training.\n\nCan you guys with 4 x 1080 Ti build share how to build such a machine? What is the convenient way to add watercooling (open loop)?", "votes": null }, { "id": "258188", "postDate": "12/15/2017 17:31:06", "content": "

I am also interested in watercooling \"tips\" and \"how to\" suggestions cause I am trying to build a devbox.

", "rawMarkdown": "I am also interested in watercooling \"tips\" and \"how to\" suggestions cause I am trying to build a devbox.", "votes": null }, { "id": "258251", "postDate": "12/15/2017 20:20:22", "content": "

About hardware.\nThere are two type of PC that suit my work style:

\n\n
    \n
  1. The main machine for coding and working on
    2. \n
  2. Devbox for training
    3. \n
\n\n

My requirements to the main machine r:

\n\n
    \n
  1. Stationary computer (hate working on laptop) with two monitors
    2. \n
  2. Maximum performance per core (during development often the code is not optimized for multiprocessing)
    3. \n
  3. 64+ Gb of memory (during development it happens that I load all the data in order not to workaround with the iterator)
    4. \n
  4. Small GPU like GT710, so that the X on Ubuntu did not become a slide show when GPU loaded
    5. \n
  5. Main two GPUs (1080 or 1080ti is not important, you can debug with a batch size 2)
    6. \n
  6. Quiet. So I use water cooling with custom loop (ekfluidgaminh a240g).
    7. \n
  7. Quick SSD. So I put m2 SSD 512 Gb PCI-e x4\n\"enter
    8. \n
\n\n

Requirements to the devbox:

\n\n
    \n
  1. The more GPU, the better
    2. \n
  2. The more cores, the better, if core has a frequency of at least 3.0GHz
    3. \n
  3. The more memory, the better
    4. \n
\n\n

https://pp.userapi.com/c840531/v840531424/34662/yKdguzhp9WQ.jpg

\n\n

Building it with water cooling expensive. It's easier and cheaper to build it like mining-rig on open stand and with risers. IMHO the cheapest solution is to build on 2011-3 socket. The processors are still quite fast for DL ​​tasks. \nIn this case, the appropriate motherboard: Asus X99-E WS, Asus X99-E-10G WS, Asus X99-E WS / USB 3.1, Asrock X99 WS, Asrock X99 WS-E / 10G\nThese motherboards are suitable for two reasons: They support 4 x16 PCI-e slots and the slots are positioned so that you can put 4 two-slot video cards without pain.\nCPU:\ni7 5930k, i7-5960X, i7 6850k, i7-6900K, i7-6950X.\nThese processors are suitable because they support 40 PCI-lanes. You can also take an engineering sample of Xeon.\nRAM:\nAny DDR4 memory. It's better to just take the 16GB stick for easer upgrade to add memory. It's better to begin with at least 32GB, otherwise it's not enough.\nPower Supply:\nhttp://www.realhardtechx.com/index_archivos/Page362.htm

", "rawMarkdown": "About hardware.\nThere are two type of PC that suit my work style:\n\n 1. The main machine for coding and working on\n 2. Devbox for training\n\nMy requirements to the main machine r:\n\n 1. Stationary computer (hate working on laptop) with two monitors\n 2. Maximum performance per core (during development often the code is not optimized for multiprocessing)\n 3. 64+ Gb of memory (during development it happens that I load all the data in order not to workaround with the iterator)\n 4. Small GPU like GT710, so that the X on Ubuntu did not become a slide show when GPU loaded\n 5. Main two GPUs (1080 or 1080ti is not important, you can debug with a batch size 2)\n 6. Quiet. So I use water cooling with custom loop (ekfluidgaminh a240g). \n 7. Quick SSD. So I put m2 SSD 512 Gb PCI-e x4\n![enter image description here][1]\n\nRequirements to the devbox:\n\n 1. The more GPU, the better\n 2. The more cores, the better, if core has a frequency of at least 3.0GHz\n 3. The more memory, the better\n\nhttps://pp.userapi.com/c840531/v840531424/34662/yKdguzhp9WQ.jpg\n\nBuilding it with water cooling expensive. It's easier and cheaper to build it like mining-rig on open stand and with risers. IMHO the cheapest solution is to build on 2011-3 socket. The processors are still quite fast for DL ​​tasks. \nIn this case, the appropriate motherboard: Asus X99-E WS, Asus X99-E-10G WS, Asus X99-E WS / USB 3.1, Asrock X99 WS, Asrock X99 WS-E / 10G\nThese motherboards are suitable for two reasons: They support 4 x16 PCI-e slots and the slots are positioned so that you can put 4 two-slot video cards without pain.\nCPU:\ni7 5930k, i7-5960X, i7 6850k, i7-6900K, i7-6950X.\nThese processors are suitable because they support 40 PCI-lanes. You can also take an engineering sample of Xeon.\nRAM:\nAny DDR4 memory. It's better to just take the 16GB stick for easer upgrade to add memory. It's better to begin with at least 32GB, otherwise it's not enough.\nPower Supply:\nhttp://www.realhardtechx.com/index_archivos/Page362.htm\n\n\n [1]: https://pp.userapi.com/c837123/v837123660/5ca80/FOZ8LChe-EA.jpg", "votes": null }, { "id": "258254", "postDate": "12/15/2017 20:32:31", "content": "

Same team. 32 GB RAM, 1 Titan X gpu.

", "rawMarkdown": "Same team. 32 GB RAM, 1 Titan X gpu.", "votes": null }, { "id": "258368", "postDate": "12/16/2017 01:40:06", "content": "

Thank you so much. I did some research about the hardware requirements after reading your post.

\n\n

So you don't watercool your 4 x 1080 ti? My titan XPs reach 85 degrees Celsius within one minute and downclock. Do you have the same heating problems with your 1080 tis?

", "rawMarkdown": "Thank you so much. I did some research about the hardware requirements after reading your post.\n\nSo you don't watercool your 4 x 1080 ti? My titan XPs reach 85 degrees Celsius within one minute and downclock. Do you have the same heating problems with your 1080 tis?", "votes": null }, { "id": "258390", "postDate": "12/16/2017 02:43:50", "content": "

Well, I'm from Russia. So, you know... siberian winter.\nAlso I set fan speed to about 95% manually. All my cards have less than 80 C without water cooling

", "rawMarkdown": "Well, I'm from Russia. So, you know... siberian winter.\nAlso I set fan speed to about 95% manually. All my cards have less than 80 C without water cooling", "votes": null }, { "id": "258717", "postDate": "12/16/2017 21:31:25", "content": "

Thanks for the specs. Pic looks great. Can you approximately say how much was the cost of the dev box?

", "rawMarkdown": "Thanks for the specs. Pic looks great. Can you approximately say how much was the cost of the dev box?", "votes": null }, { "id": "258923", "postDate": "12/17/2017 10:53:02", "content": "

~ 3.5k $ for main machine and ~ 8.5k $ for 4x 1080ti devbox

", "rawMarkdown": "~ 3.5k $ for main machine and ~ 8.5k $ for 4x 1080ti devbox", "votes": null }, { "id": "259028", "postDate": "12/17/2017 14:54:56", "content": "

Thanks! Appreciate it.

", "rawMarkdown": "Thanks! Appreciate it.", "votes": null }, { "id": "261110", "postDate": "12/21/2017 19:57:09", "content": "

Hi Heng,\nmay I ask what type PSU are you using for the 4xTi.\nIs it a 1200W or more?

\n\n

Thanks!

", "rawMarkdown": "Hi Heng,\nmay I ask what type PSU are you using for the 4xTi.\nIs it a 1200W or more?\n\nThanks!", "votes": null } ], "comments": [ { "id": 257873, "author_name": "blackarrow3542", "author_url": "", "post_date": "12/15/2017 02:41:08", "content": "
    \n
  1. AMD 1950x, 128G ram, 4xGtx 1080 ti
    2. \n
", "votes": null, "replies": [ { "id": 257878, "author_name": "jandjenter", "author_url": "", "post_date": "12/15/2017 02:46:38", "content": "

Same team as Enhao,

\n\n

64Gb RAM, 2x GTX 1080 Ti

", "votes": null, "replies": [] }, { "id": 258254, "author_name": "sgalib", "author_url": "", "post_date": "12/15/2017 20:32:31", "content": "

Same team. 32 GB RAM, 1 Titan X gpu.

", "votes": null, "replies": [] } ] }, { "id": 257882, "author_name": "radustoicescu", "author_url": "", "post_date": "12/15/2017 02:52:56", "content": "

One GTX1070, 32GB RAM

", "votes": null, "replies": [] }, { "id": 257936, "author_name": "hengck23", "author_url": "", "post_date": "12/15/2017 05:16:13", "content": "

\"4x 1080Ti\" and \"1x pascal titianX\"

", "votes": null, "replies": [ { "id": 261110, "author_name": "kirk86", "author_url": "", "post_date": "12/21/2017 19:57:09", "content": "

Hi Heng,\nmay I ask what type PSU are you using for the 4xTi.\nIs it a 1200W or more?

\n\n

Thanks!

", "votes": null, "replies": [] } ] }, { "id": 257992, "author_name": "drn01z3", "author_url": "", "post_date": "12/15/2017 08:08:53", "content": "", "votes": null, "replies": [] }, { "id": 258148, "author_name": "nighturs", "author_url": "", "post_date": "12/15/2017 16:04:34", "content": "

8 GB RAM, One GTX 1050 Ti

", "votes": null, "replies": [] }, { "id": 258166, "author_name": "wowfattie", "author_url": "", "post_date": "12/15/2017 16:37:57", "content": "

I have 4 titan XPs. But currently they are in separate machines. I initially bought them for my own research which does not require parallelism. I would like to merge them into one for parallel training.

\n\n

Can you guys with 4 x 1080 Ti build share how to build such a machine? What is the convenient way to add watercooling (open loop)?

", "votes": null, "replies": [ { "id": 258188, "author_name": "kirk86", "author_url": "", "post_date": "12/15/2017 17:31:06", "content": "

I am also interested in watercooling \"tips\" and \"how to\" suggestions cause I am trying to build a devbox.

", "votes": null, "replies": [] } ] }, { "id": 258251, "author_name": "drn01z3", "author_url": "", "post_date": "12/15/2017 20:20:22", "content": "

About hardware.\nThere are two type of PC that suit my work style:

\n\n
    \n
  1. The main machine for coding and working on
    2. \n
  2. Devbox for training
    3. \n
\n\n

My requirements to the main machine r:

\n\n
    \n
  1. Stationary computer (hate working on laptop) with two monitors
    2. \n
  2. Maximum performance per core (during development often the code is not optimized for multiprocessing)
    3. \n
  3. 64+ Gb of memory (during development it happens that I load all the data in order not to workaround with the iterator)
    4. \n
  4. Small GPU like GT710, so that the X on Ubuntu did not become a slide show when GPU loaded
    5. \n
  5. Main two GPUs (1080 or 1080ti is not important, you can debug with a batch size 2)
    6. \n
  6. Quiet. So I use water cooling with custom loop (ekfluidgaminh a240g).
    7. \n
  7. Quick SSD. So I put m2 SSD 512 Gb PCI-e x4\n\"enter
    8. \n
\n\n

Requirements to the devbox:

\n\n
    \n
  1. The more GPU, the better
    2. \n
  2. The more cores, the better, if core has a frequency of at least 3.0GHz
    3. \n
  3. The more memory, the better
    4. \n
\n\n

https://pp.userapi.com/c840531/v840531424/34662/yKdguzhp9WQ.jpg

\n\n

Building it with water cooling expensive. It's easier and cheaper to build it like mining-rig on open stand and with risers. IMHO the cheapest solution is to build on 2011-3 socket. The processors are still quite fast for DL ​​tasks. \nIn this case, the appropriate motherboard: Asus X99-E WS, Asus X99-E-10G WS, Asus X99-E WS / USB 3.1, Asrock X99 WS, Asrock X99 WS-E / 10G\nThese motherboards are suitable for two reasons: They support 4 x16 PCI-e slots and the slots are positioned so that you can put 4 two-slot video cards without pain.\nCPU:\ni7 5930k, i7-5960X, i7 6850k, i7-6900K, i7-6950X.\nThese processors are suitable because they support 40 PCI-lanes. You can also take an engineering sample of Xeon.\nRAM:\nAny DDR4 memory. It's better to just take the 16GB stick for easer upgrade to add memory. It's better to begin with at least 32GB, otherwise it's not enough.\nPower Supply:\nhttp://www.realhardtechx.com/index_archivos/Page362.htm

", "votes": null, "replies": [ { "id": 258368, "author_name": "wowfattie", "author_url": "", "post_date": "12/16/2017 01:40:06", "content": "

Thank you so much. I did some research about the hardware requirements after reading your post.

\n\n

So you don't watercool your 4 x 1080 ti? My titan XPs reach 85 degrees Celsius within one minute and downclock. Do you have the same heating problems with your 1080 tis?

", "votes": null, "replies": [] }, { "id": 258390, "author_name": "drn01z3", "author_url": "", "post_date": "12/16/2017 02:43:50", "content": "

Well, I'm from Russia. So, you know... siberian winter.\nAlso I set fan speed to about 95% manually. All my cards have less than 80 C without water cooling

", "votes": null, "replies": [] }, { "id": 258717, "author_name": "kirk86", "author_url": "", "post_date": "12/16/2017 21:31:25", "content": "

Thanks for the specs. Pic looks great. Can you approximately say how much was the cost of the dev box?

", "votes": null, "replies": [] }, { "id": 258923, "author_name": "drn01z3", "author_url": "", "post_date": "12/17/2017 10:53:02", "content": "

~ 3.5k $ for main machine and ~ 8.5k $ for 4x 1080ti devbox

", "votes": null, "replies": [] }, { "id": 259028, "author_name": "kirk86", "author_url": "", "post_date": "12/17/2017 14:54:56", "content": "

Thanks! Appreciate it.

", "votes": null, "replies": [] } ] } ], "raw_markdown_by_id": { "257836": "To start:\n\n 1. 32 Gb RAM, 2 x Titan Pascal X for prototyping\n 2. 32 Gb RAM, 4 x GTX 1080 Ti for heavy lifting", "257873": "1. AMD 1950x, 128G ram, 4xGtx 1080 ti", "257878": "Same team as Enhao,\n\n64Gb RAM, 2x GTX 1080 Ti", "257882": "One GTX1070, 32GB RAM", "257936": "\"4x 1080Ti\" and \"1x pascal titianX\"", "257992": "i7 7700k, 64gb, 2x 1080 (for working and coding)\n \n - i7 6700k, 32gb, 2х Titan X (Maxwell) (headless learning devbox)\n\n \n - i7 5930K, 32gb, 3x 1080Ti (headless learning devbox)\n\n \n - Xeon 2696v3, 64gb, 4x 1080Ti (headless learning devbox)", "258148": "8 GB RAM, One GTX 1050 Ti", "258166": "I have 4 titan XPs. But currently they are in separate machines. I initially bought them for my own research which does not require parallelism. I would like to merge them into one for parallel training.\n\nCan you guys with 4 x 1080 Ti build share how to build such a machine? What is the convenient way to add watercooling (open loop)?", "258188": "I am also interested in watercooling \"tips\" and \"how to\" suggestions cause I am trying to build a devbox.", "258251": "About hardware.\nThere are two type of PC that suit my work style:\n\n 1. The main machine for coding and working on\n 2. Devbox for training\n\nMy requirements to the main machine r:\n\n 1. Stationary computer (hate working on laptop) with two monitors\n 2. Maximum performance per core (during development often the code is not optimized for multiprocessing)\n 3. 64+ Gb of memory (during development it happens that I load all the data in order not to workaround with the iterator)\n 4. Small GPU like GT710, so that the X on Ubuntu did not become a slide show when GPU loaded\n 5. Main two GPUs (1080 or 1080ti is not important, you can debug with a batch size 2)\n 6. Quiet. So I use water cooling with custom loop (ekfluidgaminh a240g). \n 7. Quick SSD. So I put m2 SSD 512 Gb PCI-e x4\n![enter image description here][1]\n\nRequirements to the devbox:\n\n 1. The more GPU, the better\n 2. The more cores, the better, if core has a frequency of at least 3.0GHz\n 3. The more memory, the better\n\nhttps://pp.userapi.com/c840531/v840531424/34662/yKdguzhp9WQ.jpg\n\nBuilding it with water cooling expensive. It's easier and cheaper to build it like mining-rig on open stand and with risers. IMHO the cheapest solution is to build on 2011-3 socket. The processors are still quite fast for DL ​​tasks. \nIn this case, the appropriate motherboard: Asus X99-E WS, Asus X99-E-10G WS, Asus X99-E WS / USB 3.1, Asrock X99 WS, Asrock X99 WS-E / 10G\nThese motherboards are suitable for two reasons: They support 4 x16 PCI-e slots and the slots are positioned so that you can put 4 two-slot video cards without pain.\nCPU:\ni7 5930k, i7-5960X, i7 6850k, i7-6900K, i7-6950X.\nThese processors are suitable because they support 40 PCI-lanes. You can also take an engineering sample of Xeon.\nRAM:\nAny DDR4 memory. It's better to just take the 16GB stick for easer upgrade to add memory. It's better to begin with at least 32GB, otherwise it's not enough.\nPower Supply:\nhttp://www.realhardtechx.com/index_archivos/Page362.htm\n\n\n [1]: https://pp.userapi.com/c837123/v837123660/5ca80/FOZ8LChe-EA.jpg", "258254": "Same team. 32 GB RAM, 1 Titan X gpu.", "258368": "Thank you so much. I did some research about the hardware requirements after reading your post.\n\nSo you don't watercool your 4 x 1080 ti? My titan XPs reach 85 degrees Celsius within one minute and downclock. Do you have the same heating problems with your 1080 tis?", "258390": "Well, I'm from Russia. So, you know... siberian winter.\nAlso I set fan speed to about 95% manually. All my cards have less than 80 C without water cooling", "258717": "Thanks for the specs. Pic looks great. Can you approximately say how much was the cost of the dev box?", "258923": "~ 3.5k $ for main machine and ~ 8.5k $ for 4x 1080ti devbox", "259028": "Thanks! Appreciate it.", "261110": "Hi Heng,\nmay I ask what type PSU are you using for the 4xTi.\nIs it a 1200W or more?\n\nThanks!" }, "source": "meta" }