{"cells":[{"metadata":{"trusted":false,"collapsed":true,"_uuid":"b1cdd9a9ff9efbe6a9bbe628f24d8f8df066ac03"},"cell_type":"code","source":"from IPython.core.display import HTML","execution_count":null,"outputs":[]},{"metadata":{"_uuid":"f4b118a66a836e3b525ca9bec775793c7763b209"},"cell_type":"markdown","source":"# Scatter Plots of IP over Time per Channel: part 1\n\nThese are some scatter plots of clicks over time.\n\nThey show the interaction between [ip, channel, time, is_attributed].\n\n - time (x axis)\n - ip (y axis)\n - channel (1 per plot)\n - is_attributed (color)\n\nColor key:\n\n - green test set (test supplement, the original full test set)\n - blue is_attributed==0\n - red is_attributed==1\n\nDays are quite clearly visible by the new block of IPs that were sampled by TalkingData for each day. The test set at the end has only low IP values as already [revealed][1]/[shared][2] by [others][3].\n\nNote that the test set (green, day 4) does contain new IP addresses, but all in the lowest range of IPs, up to 126413. This is not clear from these plots.\n\nFor more details on the IP encoding see:\n\n - [False Leak? (discussion by Andy Harless)][1]\n - [Be careful about IPs as a Signal (kernel by Yulia)][2]\n - [IP Download Rates (kernel by CPMP)][3]\n\nThe plots are pregenerated by some old Java code I have, which is not shared here, only the output, partly as a test in autogenerating Jupyter Notebooks (using the nbformat module).\n\n(The embedded files are actually a little larger than shown in the Notebook, you can right click → View Image to see the full size.)\n\nI think the plots alone are worth sharing, they contain useful insights into the IP behaviour over time.\n\nI selected the most interesting plots to share then ran into the problem that notebooks are limited to 1Mb of source code, so I've split them into two kernels.\n\nThis is part 1, [part 2][4] is here.\n\n [1]: https://www.kaggle.com/c/talkingdata-adtracking-fraud-detection/discussion/52374\n [2]: https://www.kaggle.com/yuliagm/be-careful-about-ips-as-a-signal\n [3]: https://www.kaggle.com/cpmpml/ip-download-rates\n [4]: https://www.kaggle.com/jtrotman/scatter-plots-of-ip-over-time-per-channel-part-2\n\n\n"},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"910747006377ce936945e5010de7045ab223c8ad"},"cell_type":"code","source":"chan5 = '''

[channel 5] ip vs time


\n13073 points
\n[602865.0..921026.0] (x time in seconds)
\n[41.0..364739.0] (y ip number)
\n[test x 3416, dud x 3877, is_attributed x 5780]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"b5fa2c9cd21901666c1395eedcad6e47d3933c55"},"cell_type":"code","source":"chan13 = '''

[channel 13] ip vs time


\n134078 points
\n[576002.0..921592.0] (x time in seconds)
\n[1.0..364773.0] (y ip number)
\n[test x 18446, dud x 115618, is_attributed x 14]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"2d711724ae97cd2184d33529aefab7b67fb32b7d"},"cell_type":"code","source":"chan18 = '''

[channel 18] ip vs time


\n107158 points
\n[576000.0..921600.0] (x time in seconds)
\n[19.0..364776.0] (y ip number)
\n[test x 51888, dud x 55241, is_attributed x 29]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"17f952306e7f0b9ae7bfb13f19554ec9f0f85c35"},"cell_type":"code","source":"chan21 = '''

[channel 21] ip vs time


\n377510 points
\n[574867.0..921599.0] (x time in seconds)
\n[6.0..364759.0] (y ip number)
\n[test x 74275, dud x 260766, is_attributed x 42469]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"23e0943789f5083527febd98959c2e9bcee4402f"},"cell_type":"code","source":"chan24 = '''

[channel 24] ip vs time


\n77606 points
\n[576001.0..921515.0] (x time in seconds)
\n[6.0..364701.0] (y ip number)
\n[test x 7151, dud x 70443, is_attributed x 12]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"d80b2a2c02116b623aa0c4439324e7e96cbdf95d"},"cell_type":"code","source":"chan113 = '''

[channel 113] ip vs time


\n553573 points
\n[576001.0..921600.0] (x time in seconds)
\n[1.0..364776.0] (y ip number)
\n[test x 79285, dud x 418422, is_attributed x 55866]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"afb0b000606b78fed13e8b79a264e923664f5bef"},"cell_type":"code","source":"chan114 = '''

[channel 114] ip vs time


\n853 points
\n[591520.0..906796.0] (x time in seconds)
\n[509.0..364628.0] (y ip number)
\n[test x 176, dud x 48, is_attributed x 629]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"12308b3880cc95c7b462c0275ee79e084afc9f58"},"cell_type":"code","source":"chan174 = '''

[channel 174] ip vs time


\n24680 points
\n[580477.0..921593.0] (x time in seconds)
\n[20.0..364026.0] (y ip number)
\n[test x 622, dud x 24053, is_attributed x 5]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"f99033138e8e0a22c08fe8383e07d10ac5b9aa43"},"cell_type":"code","source":"chan182 = '''

[channel 182] ip vs time


\n150653 points
\n[576003.0..921590.0] (x time in seconds)
\n[1.0..364773.0] (y ip number)
\n[test x 20080, dud x 130473, is_attributed x 100]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"686cb24395b2870ab47550f60bf3a4850c898b02"},"cell_type":"code","source":"chan222 = '''

[channel 222] ip vs time


\n779 points
\n[576007.0..920246.0] (x time in seconds)
\n[1049.0..362485.0] (y ip number)
\n[test x 51, dud x 614, is_attributed x 114]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"73a995de305a7386f614971263b3cc8a596324e3"},"cell_type":"code","source":"chan225 = '''

[channel 225] ip vs time


\n12515 points
\n[576656.0..921598.0] (x time in seconds)
\n[10.0..359109.0] (y ip number)
\n[test x 12419, dud x 69, is_attributed x 27]
'''","execution_count":null,"outputs":[]},{"metadata":{"_kg_hide-input":true,"trusted":false,"collapsed":true,"_uuid":"e3bf37d1624d9adaaa9b90159d674f285f776bb4"},"cell_type":"code","source":"chan274 = '''

[channel 274] ip vs time


\n42404 points
\n[576003.0..921565.0] (x time in seconds)
\n[9.0..364748.0] (y ip number)
\n[test x 3932, dud x 12584, is_attributed x 25888]
'''","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"8dbe780047250cbc5095e1ee7418b768f77975f8"},"cell_type":"code","source":"HTML(chan5)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"20bf0bee33738e94d8c8c424b2ce57d6c704c3eb"},"cell_type":"code","source":"HTML(chan13)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"1664ffb08501f2aff8b17a0c53e898248a32a386"},"cell_type":"code","source":"HTML(chan18)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"5dedcbeeb7e5964d03db1621d21a367cd56f3108"},"cell_type":"code","source":"HTML(chan21)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"4f50dd1a403407109babf73b6cb7e433b141cbdf"},"cell_type":"code","source":"HTML(chan24)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"f242fb7f0a585264e4257a1dd803c876109b8c5b"},"cell_type":"code","source":"HTML(chan113)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"635479e97032e07c4eacb05bf443f34da437c67f"},"cell_type":"code","source":"HTML(chan114)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"a27d7a8cef792d94398e7daeb151bb183bc273b3"},"cell_type":"code","source":"HTML(chan174)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"70f323018e7f323319770d047f075f05d5fcd2d2"},"cell_type":"code","source":"HTML(chan182)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"176be94e457521ee912a3e2791c800d89d3e9636"},"cell_type":"code","source":"HTML(chan222)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"1a4acb444e54450350c6ebcf9b0c7649eb137452"},"cell_type":"code","source":"HTML(chan225)","execution_count":null,"outputs":[]},{"metadata":{"trusted":false,"collapsed":true,"_uuid":"83dcc5b72ac2e38f127eed11f464976e20b39c50"},"cell_type":"code","source":"HTML(chan274)","execution_count":null,"outputs":[]}],"metadata":{"kernelspec":{"display_name":"Python 3","language":"python","name":"python3"}},"nbformat":4,"nbformat_minor":1}