{"cells":[{"metadata":{"trusted":false,"collapsed":true,"_uuid":"f6ff420330a90aa9d7495b8c619b445415561352"},"cell_type":"code","source":"from IPython.core.display import HTML","execution_count":null,"outputs":[]},{"metadata":{"_uuid":"61981bc452d595d9dcbed0fb0837bc495081f34f"},"cell_type":"markdown","source":"# Scatter Plots of IP over Time per Channel: part 2\n\nThese are some scatter plots of clicks over time.\n\nThey show the interaction between [ip, channel, time, is_attributed].\n\n - time (x axis)\n - ip (y axis)\n - channel (1 per plot)\n - is_attributed (color)\n\nColor key:\n\n - green test set (test supplement, the original full test set)\n - blue is_attributed==0\n - red is_attributed==1\n\nDays are quite clearly visible by the new block of IPs that were sampled by TalkingData for each day. The test set at the end has only low IP values as already [revealed][1]/[shared][2] by [others][3].\n\nNote that the test set (green, day 4) does contain new IP addresses, but all in the lowest range of IPs, up to 126413. This is not clear from these plots.\n\nFor more details on the IP encoding see:\n\n - [False Leak? (discussion by Andy Harless)][1]\n - [Be careful about IPs as a Signal (kernel by Yulia)][2]\n - [IP Download Rates (kernel by CPMP)][3]\n\nThe plots are pregenerated by some old Java code I have, which is not shared here, only the output, partly as a test in autogenerating Jupyter Notebooks (using the nbformat module).\n\n(The embedded files are actually a little larger than shown in the Notebook, you can right click → View Image to see the full size.)\n\nI think the plots alone are worth sharing, they contain useful insights into the IP behaviour over time.\n\nI selected the most interesting plots to share then ran into the problem that notebooks are limited to 1Mb of source code, so I've split them into two kernels.\n\nThis is part 2, [part 1][4] is here.\n\n [1]: https://www.kaggle.com/c/talkingdata-adtracking-fraud-detection/discussion/52374\n [2]: https://www.kaggle.com/yuliagm/be-careful-about-ips-as-a-signal\n [3]: https://www.kaggle.com/cpmpml/ip-download-rates\n [4]: https://www.kaggle.com/jtrotman/scatter-plots-of-ip-over-time-per-channel-part-1\n\n\n"},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"93969d76f9a3a0613335226f28626e527f86012c"},"cell_type":"code","source":"chan320 = '''

[channel 320] ip vs time


\n32596 points
\n[576002.0..921541.0] (x time in seconds)
\n[20.0..364772.0] (y ip number)
\n[test x 3340, dud x 27660, is_attributed x 1596]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"d51c6e6a8ad08351f303697c01bc5cf3b194e1d2"},"cell_type":"code","source":"chan330 = '''

[channel 330] ip vs time


\n67881 points
\n[576036.0..921585.0] (x time in seconds)
\n[9.0..364775.0] (y ip number)
\n[test x 6184, dud x 59985, is_attributed x 1712]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"e5732c725e2004c9f220b07e44820d4971a4ca8d"},"cell_type":"code","source":"chan332 = '''

[channel 332] ip vs time


\n10754 points
\n[576764.0..921549.0] (x time in seconds)
\n[20.0..364735.0] (y ip number)
\n[test x 1691, dud x 7769, is_attributed x 1294]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"dd42ccf41db6434d7fed780e3d50958e4a210e60"},"cell_type":"code","source":"chan361 = '''

[channel 361] ip vs time


\n105945 points
\n[576429.0..921597.0] (x time in seconds)
\n[9.0..364778.0] (y ip number)
\n[test x 9113, dud x 96816, is_attributed x 16]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"36ab1a7b851265f55f466dea114cb86b799aec1d"},"cell_type":"code","source":"chan364 = '''

[channel 364] ip vs time


\n852316 points
\n[576000.0..921600.0] (x time in seconds)
\n[21.0..364494.0] (y ip number)
\n[test x 200175, dud x 652131, is_attributed x 10]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"332dfd464d19c4082a00307447e0a48ce5f79b1c"},"cell_type":"code","source":"chan391 = '''

[channel 391] ip vs time


\n64441 points
\n[576008.0..921503.0] (x time in seconds)
\n[9.0..364776.0] (y ip number)
\n[test x 2441, dud x 61954, is_attributed x 46]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"873339e751c922257b61e467dcbe292b9f573734"},"cell_type":"code","source":"chan408 = '''

[channel 408] ip vs time


\n897 points
\n[609583.0..909303.0] (x time in seconds)
\n[691.0..364738.0] (y ip number)
\n[test x 203, dud x 33, is_attributed x 661]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"793b2a728c4f8edd10c5d26f1c48faaa63028e5f"},"cell_type":"code","source":"chan419 = '''

[channel 419] ip vs time


\n14370 points
\n[576005.0..921550.0] (x time in seconds)
\n[69.0..364769.0] (y ip number)
\n[test x 3999, dud x 3696, is_attributed x 6675]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"cee91723c3f768dc9cdd36c4426adcebb4cb346e"},"cell_type":"code","source":"chan446 = '''

[channel 446] ip vs time


\n96254 points
\n[576042.0..921596.0] (x time in seconds)
\n[20.0..364549.0] (y ip number)
\n[test x 10873, dud x 85366, is_attributed x 15]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"82c4c408c37ff25129a7eac3c99b2646889d5e74"},"cell_type":"code","source":"chan465 = '''

[channel 465] ip vs time


\n5272 points
\n[576059.0..921176.0] (x time in seconds)
\n[215.0..364725.0] (y ip number)
\n[test x 1577, dud x 1089, is_attributed x 2606]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"341556771fef39fc6c4488c8dfaa53698ecab914"},"cell_type":"code","source":"chan484 = '''

[channel 484] ip vs time


\n108027 points
\n[576001.0..921594.0] (x time in seconds)
\n[20.0..364776.0] (y ip number)
\n[test x 18580, dud x 89441, is_attributed x 6]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"140636fb3d0277ba4a162d9aa1950c59680365e5"},"cell_type":"code","source":"chan498 = '''

[channel 498] ip vs time


\n1845 points
\n[576012.0..921525.0] (x time in seconds)
\n[235.0..363929.0] (y ip number)
\n[test x 705, dud x 1068, is_attributed x 72]
'''","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"0aeb8941c79da580dab618438adacec940af385a"},"cell_type":"code","source":"HTML(chan320)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"8e50af822dcd57877a07422025abac663151eec4"},"cell_type":"code","source":"HTML(chan330)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"353d146ac31ae124c3ecc3528ddf9bee17ed7f84"},"cell_type":"code","source":"HTML(chan332)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"bea4130d6f06f433d2709437dc42fd7e2f7cf942"},"cell_type":"code","source":"HTML(chan361)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"44b69dabbfac526d721836cc1221027266556974"},"cell_type":"code","source":"HTML(chan364)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"169020afb8e778c7afc47e8539dbb037da6fd628"},"cell_type":"code","source":"HTML(chan391)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"eb72f66318931f34a73181c0dc8ccaccf9ae0692"},"cell_type":"code","source":"HTML(chan408)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"c0dc1e71ef3b92b1989783742b8ea481018a0579"},"cell_type":"code","source":"HTML(chan419)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"b516567de0dcc93dda8a7863491c446a35796e6a"},"cell_type":"code","source":"HTML(chan446)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"43e12e0e83024b2911e442a761b755e26cea3e3d"},"cell_type":"code","source":"HTML(chan465)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"c27775146a4385a0f44cd3f3c1cae79a7275b953"},"cell_type":"code","source":"HTML(chan484)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"c009855772233b128be979035a35cec1cc1f0e5d"},"cell_type":"code","source":"HTML(chan498)","execution_count":null,"outputs":[]}],"metadata":{"kernelspec":{"display_name":"Python 3","language":"python","name":"python3"}},"nbformat":4,"nbformat_minor":1}