{ "id": 237961, "title": "Welcome to the Breakthrough Listen ET signal search challenge!", "url": "/competitions/seti-breakthrough-listen/discussion/237961", "author_name": "Steve Croft", "post_date": "2021-05-10T21:18:19.668000", "votes": 36, "comment_count": 24, "views": 0, "content": "

Welcome to the Breakthrough Listen \"ET signal search\" challenge. Listen is the largest search for extraterrestrial intelligence (SETI) program to date, and we're using telescopes around the world, including the planet's largest steerable dish, the Green Bank Telescope. One of our main data analysis challenges is sifting through the haystack of human-generated radio interference to find faint signals of interest. The Listen science team, based in the UC Berkeley Astronomy department, is excited to see what algorithms you come up with to help us with the search.

\n

Good luck!

", "messages": [ { "id": 1300945, "postDate": "2021-05-10T21:18:19.670Z", "content": "

Welcome to the Breakthrough Listen \"ET signal search\" challenge. Listen is the largest search for extraterrestrial intelligence (SETI) program to date, and we're using telescopes around the world, including the planet's largest steerable dish, the Green Bank Telescope. One of our main data analysis challenges is sifting through the haystack of human-generated radio interference to find faint signals of interest. The Listen science team, based in the UC Berkeley Astronomy department, is excited to see what algorithms you come up with to help us with the search.

\n

Good luck!

", "rawMarkdown": "Welcome to the Breakthrough Listen \"ET signal search\" challenge. *Listen* is the largest search for extraterrestrial intelligence (SETI) program to date, and we're using telescopes around the world, including the planet's largest steerable dish, the Green Bank Telescope. One of our main data analysis challenges is sifting through the haystack of human-generated radio interference to find faint signals of interest. The *Listen* science team, based in the UC Berkeley Astronomy department, is excited to see what algorithms you come up with to help us with the search.\n\nGood luck!", "votes": 36 }, { "id": 1300951, "postDate": "2021-05-10T21:23:04.637Z", "content": "

Hi, this looks a great challenge.

\n

I read the very interesting data information and I wonder what is the red diagonal in the voyager cadence. From the explanation it should be a terrestrial source, but it also has a Doppler effect.

\n

\"voyager\"

", "rawMarkdown": "Hi, this looks a great challenge.\n\nI read the very interesting data information and I wonder what is the red diagonal in the voyager cadence. From the explanation it should be a terrestrial source, but it also has a Doppler effect.\n\n![voyager](https://storage.googleapis.com/kaggle-media/competitions/SETI-Berkeley/Screen%20Shot%202021-05-03%20at%2011.39.42.png)", "votes": 7, "replies": [ { "id": 1300975, "postDate": "2021-05-10T21:43:06.840Z", "content": "

Hi!

\n

The red line is actually just a reference line that we draw on the plot based on the start channel and drift rate of the detected hit. It's not part of the data itself.

\n

We draw these lines to make it easier to see the signals we're referring to since not all detected signals stand out as much as the Voyager signal. These lines are shifted slightly to the right so that they don't block the actual signal.

", "rawMarkdown": "Hi!\n\nThe red line is actually just a reference line that we draw on the plot based on the start channel and drift rate of the detected hit. It's not part of the data itself. \n\nWe draw these lines to make it easier to see the signals we're referring to since not all detected signals stand out as much as the Voyager signal. These lines are shifted slightly to the right so that they don't block the actual signal.", "votes": 7 }, { "id": 1301001, "postDate": "2021-05-10T22:10:30.380Z", "content": "

Thanks, makes sense. What matters is this:

\n
\n

It's not part of the data itself.

\n
", "rawMarkdown": "Thanks, makes sense. What matters is this:\n\n> It's not part of the data itself. ", "votes": 5 } ] }, { "id": 1309609, "postDate": "2021-05-16T06:18:46.913Z", "content": "

I found \"\"kaggle\" in a spectrogram.
\nplease check the last ot this notebook.

\n

what's this???

", "rawMarkdown": "I found \"\"kaggle\" in a spectrogram.\nplease check the last ot [this notebook](https://www.kaggle.com/abebe9849/vis-oof).\n\nwhat's this???", "votes": 8 }, { "id": 1327642, "postDate": "2021-05-29T13:43:12.490Z", "content": "

have some confusion regarding the cadence 2d arrays in train files. Correct me if I'm wrong

\n

I) The data given is for 273 timepoints, of 256 different frequencies, but the timestamps and frequencies are not given

\n

II) The data is normalized, but not Fourier-Transformed

\n

And if anyone can help me out, with how to generate the heatmap plots used for visualizing cadence datasets

", "rawMarkdown": "have some confusion regarding the cadence 2d arrays in train files. Correct me if I'm wrong\n \nI) The data given is for 273 timepoints, of 256 different frequencies, but the timestamps and frequencies are not given \n\nII) The data is normalized, but not Fourier-Transformed\n\nAnd if anyone can help me out, with how to generate the heatmap plots used for visualizing cadence datasets", "votes": 4 }, { "id": 1302250, "postDate": "2021-05-11T13:02:12.160Z", "content": "

Hi,

\n

Thanks for a grate competition!

\n", "rawMarkdown": "Hi,\n\nThanks for a grate competition!\n\n- Is any chance to get the raw 1D signals?\n- What are params of the spectrograms?\n\n\n\n\n", "votes": 1 }, { "id": 1301041, "postDate": "2021-05-10T23:22:06.570Z", "content": "

Thank you for this exciting competition 👀

", "rawMarkdown": "Thank you for this exciting competition 👀", "votes": 1 }, { "id": 1310610, "postDate": "2021-05-16T18:55:50.930Z", "content": "

First of all thank you @stevecroft for hosting such an interesting competition.

\n", "rawMarkdown": "First of all thank you @stevecroft for hosting such an interesting competition.\n\n- Do you have any recommendations for newcomers to SETI? \n- Are there any good sources/readings that would help provide a solid base on the topics of extraterrestrial signal detection and human generated radio interference? ", "votes": 2, "replies": [ { "id": 1319141, "postDate": "2021-05-23T00:14:54.910Z", "content": "

I second this, I find SETI fascinating but have little experience, especially on signal detection/processing so good resources could be interesting.

", "rawMarkdown": "I second this, I find SETI fascinating but have little experience, especially on signal detection/processing so good resources could be interesting." } ] }, { "id": 1480396, "postDate": "2021-08-19T02:26:18.780Z", "content": "

Why was our team cancelled? After communicating with my teammates, I found that we did not violate two principles:

\n

One account per participant
\nYou cannot sign up to Kaggle from multiple accounts and therefore you cannot submit from multiple accounts.
\nNo private sharing outside teams
\nPrivately sharing code or data outside of teams is not permitted. It's okay to share code if made available to all participants on the forums.
\nbut our results were cancelled. Is there a staff member who can explain?

", "rawMarkdown": "Why was our team cancelled? After communicating with my teammates, I found that we did not violate two principles:\n\nOne account per participant\nYou cannot sign up to Kaggle from multiple accounts and therefore you cannot submit from multiple accounts.\nNo private sharing outside teams\nPrivately sharing code or data outside of teams is not permitted. It's okay to share code if made available to all participants on the forums.\nbut our results were cancelled. Is there a staff member who can explain?", "replies": [ { "id": 1482526, "postDate": "2021-08-20T06:08:48.987Z", "content": "

If you think you were removed by mistake, please contact compliance. Please fill in all the fields honestly.

", "rawMarkdown": "If you think you were removed by mistake, please contact [compliance](https://www.kaggle.com/compliance). Please fill in all the fields honestly." } ] }, { "id": 1370725, "postDate": "2021-06-30T11:06:11.770Z", "content": "

Must say that my profile image slightly matches this competition, I realized now that it looks like the E.T. finger with some imagination, let's see if it can give some extra luck :)

", "rawMarkdown": "Must say that my profile image slightly matches this competition, I realized now that it looks like the E.T. finger with some imagination, let's see if it can give some extra luck :)" }, { "id": 1319172, "postDate": "2021-05-23T01:47:25.090Z", "content": "

Great competition ! I hope the raw data is available and not the filtered stuff used in spectrograms . Want to try new techniques and not be presumptive in what we do . Will be fun . Just need to find the raw data

", "rawMarkdown": "Great competition ! I hope the raw data is available and not the filtered stuff used in spectrograms . Want to try new techniques and not be presumptive in what we do . Will be fun . Just need to find the raw data " }, { "id": 1302477, "postDate": "2021-05-11T15:11:01.647Z", "content": "

HI . looks very interesting. is there a copy of the raw data as the fft performed on the raw signal has a large number of asumptions in it, such as shannon nyquist etc .

", "rawMarkdown": "HI . looks very interesting. is there a copy of the raw data as the fft performed on the raw signal has a large number of asumptions in it, such as shannon nyquist etc ." }, { "id": 1302422, "postDate": "2021-05-11T14:37:06.093Z", "content": "

There are folders named [0-9]&[a-f] but I couldn't find any explanation for them.

\n
    \n
  1. Do they have any applications here?
    2. \n
  2. Also as train & test have folders by the same name, they're identical group?
    \n@yuhongc @stevecroft
    3. \n
", "rawMarkdown": "There are folders named [0-9]&[a-f] but I couldn't find any explanation for them. \n1. Do they have any applications here?\n2. Also as train & test have folders by the same name, they're identical group?\n@yuhongc @stevecroft ", "replies": [ { "id": 1302555, "postDate": "2021-05-11T15:38:39.403Z", "content": "

Hi @awsaf49 ,

\n

The folders just correspond to the first character in the hash for the npy files, the folder names aren't significant in any way.

", "rawMarkdown": "Hi @awsaf49 ,\n\nThe folders just correspond to the first character in the hash for the npy files, the folder names aren't significant in any way.", "votes": 5 } ] }, { "id": 1301713, "postDate": "2021-05-11T07:55:10.420Z", "content": "

Thank you for the competition. Questions:

\n", "rawMarkdown": "Thank you for the competition. Questions:\n- What is the spectral+temporal range and resolution of the data?\n- Are all needles narrow-band signals?\n- If my algorithm returns \"unclear\" in some cases, is it acceptable to visually inspect the data and enter (or change) the decision \"by hand\" in the submission file?", "replies": [ { "id": 1302395, "postDate": "2021-05-11T14:21:29.477Z", "content": "

From the rules page:

\n
\n

Submissions may not use or incorporate information from hand labeling or human prediction of the validation dataset or test data records.

\n
\n

It means this is not acceptable:

\n
\n

is it acceptable to visually inspect the data and enter (or change) the decision \"by hand\" in the submission file?

\n
", "rawMarkdown": "From the rules page:\n\n> Submissions may not use or incorporate information from hand labeling or human prediction of the validation dataset or test data records.\n\nIt means this is not acceptable:\n\n> is it acceptable to visually inspect the data and enter (or change) the decision \"by hand\" in the submission file?\n", "votes": 4 } ] }, { "id": 1301313, "postDate": "2021-05-11T02:51:22.313Z", "content": "

This is so interesting.

", "rawMarkdown": "This is so interesting. " }, { "id": 1390245, "postDate": "2021-07-16T13:33:44.230Z", "rawMarkdown": "", "isDeleted": true }, { "id": 1331414, "postDate": "2021-06-01T13:05:48.253Z", "rawMarkdown": "", "votes": 2, "isDeleted": true, "replies": [ { "id": 1335290, "postDate": "2021-06-04T06:13:44.707Z", "content": "

I see that you made a successful submission on 6/1.

", "rawMarkdown": "I see that you made a successful submission on 6/1. " } ] }, { "id": 1318700, "postDate": "2021-05-22T13:58:09.263Z", "content": "

Thank you for so exciting challenge!

", "rawMarkdown": "Thank you for so exciting challenge!" }, { "id": 1301141, "postDate": "2021-05-11T00:46:35.830Z", "content": "

Thank you very much for the challenge

", "rawMarkdown": "Thank you very much for the challenge\n" } ], "comments": [ { "id": 1300951, "author_name": "CPMP", "author_url": "", "post_date": "2021-05-10T21:23:04.637000", "content": "

Hi, this looks a great challenge.

\n

I read the very interesting data information and I wonder what is the red diagonal in the voyager cadence. From the explanation it should be a terrestrial source, but it also has a Doppler effect.

\n

\"voyager\"

", "votes": 7, "replies": [ { "id": 1300975, "author_name": "Yuhong Chen", "author_url": "", "post_date": "2021-05-10T21:43:06.840000", "content": "

Hi!

\n

The red line is actually just a reference line that we draw on the plot based on the start channel and drift rate of the detected hit. It's not part of the data itself.

\n

We draw these lines to make it easier to see the signals we're referring to since not all detected signals stand out as much as the Voyager signal. These lines are shifted slightly to the right so that they don't block the actual signal.

", "votes": 7, "replies": [] }, { "id": 1301001, "author_name": "CPMP", "author_url": "", "post_date": "2021-05-10T22:10:30.380000", "content": "

Thanks, makes sense. What matters is this:

\n
\n

It's not part of the data itself.

\n
", "votes": 5, "replies": [] } ] }, { "id": 1309609, "author_name": "patriot", "author_url": "", "post_date": "2021-05-16T06:18:46.913000", "content": "

I found \"\"kaggle\" in a spectrogram.
\nplease check the last ot this notebook.

\n

what's this???

", "votes": 8, "replies": [] }, { "id": 1327642, "author_name": "Pritish Ranjan", "author_url": "", "post_date": "2021-05-29T13:43:12.490000", "content": "

have some confusion regarding the cadence 2d arrays in train files. Correct me if I'm wrong

\n

I) The data given is for 273 timepoints, of 256 different frequencies, but the timestamps and frequencies are not given

\n

II) The data is normalized, but not Fourier-Transformed

\n

And if anyone can help me out, with how to generate the heatmap plots used for visualizing cadence datasets

", "votes": 4, "replies": [] }, { "id": 1302250, "author_name": "Michael Markzon", "author_url": "", "post_date": "2021-05-11T13:02:12.160000", "content": "

Hi,

\n

Thanks for a grate competition!

\n", "votes": 1, "replies": [] }, { "id": 1301041, "author_name": "Harshit Sati", "author_url": "", "post_date": "2021-05-10T23:22:06.570000", "content": "

Thank you for this exciting competition 👀

", "votes": 1, "replies": [] }, { "id": 1310610, "author_name": "Bartley", "author_url": "", "post_date": "2021-05-16T18:55:50.930000", "content": "

First of all thank you @stevecroft for hosting such an interesting competition.

\n", "votes": 2, "replies": [ { "id": 1319141, "author_name": "gtrottier", "author_url": "", "post_date": "2021-05-23T00:14:54.910000", "content": "

I second this, I find SETI fascinating but have little experience, especially on signal detection/processing so good resources could be interesting.

", "votes": 0, "replies": [] } ] }, { "id": 1480396, "author_name": "Ctrl_CV", "author_url": "", "post_date": "2021-08-19T02:26:18.780000", "content": "

Why was our team cancelled? After communicating with my teammates, I found that we did not violate two principles:

\n

One account per participant
\nYou cannot sign up to Kaggle from multiple accounts and therefore you cannot submit from multiple accounts.
\nNo private sharing outside teams
\nPrivately sharing code or data outside of teams is not permitted. It's okay to share code if made available to all participants on the forums.
\nbut our results were cancelled. Is there a staff member who can explain?

", "votes": 0, "replies": [ { "id": 1482526, "author_name": "Maggie", "author_url": "", "post_date": "2021-08-20T06:08:48.987000", "content": "

If you think you were removed by mistake, please contact compliance. Please fill in all the fields honestly.

", "votes": 0, "replies": [] } ] }, { "id": 1370725, "author_name": "Kirderf", "author_url": "", "post_date": "2021-06-30T11:06:11.770000", "content": "

Must say that my profile image slightly matches this competition, I realized now that it looks like the E.T. finger with some imagination, let's see if it can give some extra luck :)

", "votes": 0, "replies": [] }, { "id": 1319172, "author_name": "Timothy Davies", "author_url": "", "post_date": "2021-05-23T01:47:25.090000", "content": "

Great competition ! I hope the raw data is available and not the filtered stuff used in spectrograms . Want to try new techniques and not be presumptive in what we do . Will be fun . Just need to find the raw data

", "votes": 0, "replies": [] }, { "id": 1302477, "author_name": "Timothy Davies", "author_url": "", "post_date": "2021-05-11T15:11:01.647000", "content": "

HI . looks very interesting. is there a copy of the raw data as the fft performed on the raw signal has a large number of asumptions in it, such as shannon nyquist etc .

", "votes": 0, "replies": [] }, { "id": 1302422, "author_name": "Awsaf", "author_url": "", "post_date": "2021-05-11T14:37:06.093000", "content": "

There are folders named [0-9]&[a-f] but I couldn't find any explanation for them.

\n
    \n
  1. Do they have any applications here?
    2. \n
  2. Also as train & test have folders by the same name, they're identical group?
    \n@yuhongc @stevecroft
    3. \n
", "votes": 0, "replies": [ { "id": 1302555, "author_name": "Yuhong Chen", "author_url": "", "post_date": "2021-05-11T15:38:39.403000", "content": "

Hi @awsaf49 ,

\n

The folders just correspond to the first character in the hash for the npy files, the folder names aren't significant in any way.

", "votes": 5, "replies": [] } ] }, { "id": 1301713, "author_name": "Michael Hippke", "author_url": "", "post_date": "2021-05-11T07:55:10.420000", "content": "

Thank you for the competition. Questions:

\n", "votes": 0, "replies": [ { "id": 1302395, "author_name": "CPMP", "author_url": "", "post_date": "2021-05-11T14:21:29.477000", "content": "

From the rules page:

\n
\n

Submissions may not use or incorporate information from hand labeling or human prediction of the validation dataset or test data records.

\n
\n

It means this is not acceptable:

\n
\n

is it acceptable to visually inspect the data and enter (or change) the decision \"by hand\" in the submission file?

\n
", "votes": 4, "replies": [] } ] }, { "id": 1301313, "author_name": "Himanshu Bhavsar", "author_url": "", "post_date": "2021-05-11T02:51:22.313000", "content": "

This is so interesting.

", "votes": 0, "replies": [] }, { "id": 1390245, "author_name": "", "author_url": "", "post_date": "2021-07-16T13:33:44.230000", "content": "", "votes": 0, "replies": [] }, { "id": 1331414, "author_name": "", "author_url": "", "post_date": "2021-06-01T13:05:48.253000", "content": "", "votes": 2, "replies": [ { "id": 1335290, "author_name": "Maggie", "author_url": "", "post_date": "2021-06-04T06:13:44.707000", "content": "

I see that you made a successful submission on 6/1.

", "votes": 0, "replies": [] } ] }, { "id": 1318700, "author_name": "KurzyukovAndrey", "author_url": "", "post_date": "2021-05-22T13:58:09.263000", "content": "

Thank you for so exciting challenge!

", "votes": 0, "replies": [] }, { "id": 1301141, "author_name": "Daniel Kofi Osei", "author_url": "", "post_date": "2021-05-11T00:46:35.830000", "content": "

Thank you very much for the challenge

", "votes": 0, "replies": [] } ], "raw_markdown_by_id": { "1300945": "Welcome to the Breakthrough Listen \"ET signal search\" challenge. *Listen* is the largest search for extraterrestrial intelligence (SETI) program to date, and we're using telescopes around the world, including the planet's largest steerable dish, the Green Bank Telescope. One of our main data analysis challenges is sifting through the haystack of human-generated radio interference to find faint signals of interest. The *Listen* science team, based in the UC Berkeley Astronomy department, is excited to see what algorithms you come up with to help us with the search.\n\nGood luck!", "1300951": "Hi, this looks a great challenge.\n\nI read the very interesting data information and I wonder what is the red diagonal in the voyager cadence. From the explanation it should be a terrestrial source, but it also has a Doppler effect.\n\n![voyager](https://storage.googleapis.com/kaggle-media/competitions/SETI-Berkeley/Screen%20Shot%202021-05-03%20at%2011.39.42.png)", "1309609": "I found \"\"kaggle\" in a spectrogram.\nplease check the last ot [this notebook](https://www.kaggle.com/abebe9849/vis-oof).\n\nwhat's this???", "1327642": "have some confusion regarding the cadence 2d arrays in train files. Correct me if I'm wrong\n \nI) The data given is for 273 timepoints, of 256 different frequencies, but the timestamps and frequencies are not given \n\nII) The data is normalized, but not Fourier-Transformed\n\nAnd if anyone can help me out, with how to generate the heatmap plots used for visualizing cadence datasets", "1302250": "Hi,\n\nThanks for a grate competition!\n\n- Is any chance to get the raw 1D signals?\n- What are params of the spectrograms?\n\n\n\n\n", "1301041": "Thank you for this exciting competition 👀", "1310610": "First of all thank you @stevecroft for hosting such an interesting competition.\n\n- Do you have any recommendations for newcomers to SETI? \n- Are there any good sources/readings that would help provide a solid base on the topics of extraterrestrial signal detection and human generated radio interference? ", "1480396": "Why was our team cancelled? After communicating with my teammates, I found that we did not violate two principles:\n\nOne account per participant\nYou cannot sign up to Kaggle from multiple accounts and therefore you cannot submit from multiple accounts.\nNo private sharing outside teams\nPrivately sharing code or data outside of teams is not permitted. It's okay to share code if made available to all participants on the forums.\nbut our results were cancelled. Is there a staff member who can explain?", "1370725": "Must say that my profile image slightly matches this competition, I realized now that it looks like the E.T. finger with some imagination, let's see if it can give some extra luck :)", "1319172": "Great competition ! I hope the raw data is available and not the filtered stuff used in spectrograms . Want to try new techniques and not be presumptive in what we do . Will be fun . Just need to find the raw data ", "1302477": "HI . looks very interesting. is there a copy of the raw data as the fft performed on the raw signal has a large number of asumptions in it, such as shannon nyquist etc .", "1302422": "There are folders named [0-9]&[a-f] but I couldn't find any explanation for them. \n1. Do they have any applications here?\n2. Also as train & test have folders by the same name, they're identical group?\n@yuhongc @stevecroft ", "1301713": "Thank you for the competition. Questions:\n- What is the spectral+temporal range and resolution of the data?\n- Are all needles narrow-band signals?\n- If my algorithm returns \"unclear\" in some cases, is it acceptable to visually inspect the data and enter (or change) the decision \"by hand\" in the submission file?", "1301313": "This is so interesting. ", "1390245": "", "1331414": "", "1318700": "Thank you for so exciting challenge!", "1301141": "Thank you very much for the challenge\n" } }