{
  "id": 292869,
  "title": "U2net output+notebook threw error",
  "url": "/competitions/sartorius-cell-instance-segmentation/discussion/292869",
  "author_name": "",
  "post_date": "2021-12-03T20:45:00.367396100Z",
  "votes": null,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Hi everyone,<br>\nI have used u2net for segmentation<br>\nI used OpenCV to convert the output mask  to instance masks<br>\nhere is the code I used for prediction</p>\n<p>image_names, pred_annots = [],[]<br>\nfor s in sub['id']:<br>\n    img_name, prd=[],[]<br>\n    image = load_img(os.path.join(test_fol, s)+'.png')<br>\n    img = image.resize((256,256))<br>\n    img = img_to_array(img)#.astype(np.int8)<br>\n    img = np.expand_dims(img,axis=0)<br>\n    results = model.predict(img)<br>\n    results = np.squeeze(results)<br>\n    frame= binarize(results[1,:,:], threshold = 0.5)<br>\n    frame1 = np.reshape(frame,(256, 256))<br>\n    frame2 = cv2.resize(frame1, (704,520), interpolation = cv2.INTER_AREA)<br>\n   # plt.imshow(frame2)<br>\n    frame3=post_process(frame2)<br>\n    frame4=np.stack((frame3),axis=-1)<br>\n    #print(frame3.shape)<br>\n    if frame4.shape[-1]==0:<br>\n        img_name.append(s)<br>\n        prd.append('')<br>\n    else:<br>\n        if check_overlap(frame4): # if mask instances have overlap then fix it<br>\n            print(\"Overlap Found!\")<br>\n            frame4 = fix_overlap(frame4)<br>\n        for r in range(frame4.shape[2]):<br>\n            pred_mask = frame4[:, :, r]<br>\n            pred_mask = pred_mask.astype(np.uint8)</p>\n<pre><code>        img_name.append(s)\n        prd.append(rle_encode(pred_mask))\n\nimage_names.extend(img_name)\npred_annots.extend(prd)\n</code></pre>\n<p>assert len(os.listdir('../input/sartorius-cell-instance-segmentation/test'))==len(np.unique(image_names))</p>\n<p>pd.DataFrame({'id':image_names, 'predicted':pred_annots}).sort_values(['id']).to_csv('submission.csv', index=False)<br>\npd.read_csv('submission.csv').head(20)</p>\n<p>My output masks are pretty good but every time I make a submission, I get error (Notebook threw exception)<br>\nI have wasted many and many submissions<br>\nI hope anyone here can help me<br>\nIs it a memory problem????<br>\nThe notebook runs without errors but when running it to get the score, I got an error</p>",
  "messages": [
    {
      "id": "1604899",
      "postDate": "12/03/2021 20:45:00",
      "content": "<p>Hi everyone,<br>\nI have used u2net for segmentation<br>\nI used OpenCV to convert the output mask  to instance masks<br>\nhere is the code I used for prediction</p>\n<p>image_names, pred_annots = [],[]<br>\nfor s in sub['id']:<br>\n    img_name, prd=[],[]<br>\n    image = load_img(os.path.join(test_fol, s)+'.png')<br>\n    img = image.resize((256,256))<br>\n    img = img_to_array(img)#.astype(np.int8)<br>\n    img = np.expand_dims(img,axis=0)<br>\n    results = model.predict(img)<br>\n    results = np.squeeze(results)<br>\n    frame= binarize(results[1,:,:], threshold = 0.5)<br>\n    frame1 = np.reshape(frame,(256, 256))<br>\n    frame2 = cv2.resize(frame1, (704,520), interpolation = cv2.INTER_AREA)<br>\n   # plt.imshow(frame2)<br>\n    frame3=post_process(frame2)<br>\n    frame4=np.stack((frame3),axis=-1)<br>\n    #print(frame3.shape)<br>\n    if frame4.shape[-1]==0:<br>\n        img_name.append(s)<br>\n        prd.append('')<br>\n    else:<br>\n        if check_overlap(frame4): # if mask instances have overlap then fix it<br>\n            print(\"Overlap Found!\")<br>\n            frame4 = fix_overlap(frame4)<br>\n        for r in range(frame4.shape[2]):<br>\n            pred_mask = frame4[:, :, r]<br>\n            pred_mask = pred_mask.astype(np.uint8)</p>\n<pre><code>        img_name.append(s)\n        prd.append(rle_encode(pred_mask))\n\nimage_names.extend(img_name)\npred_annots.extend(prd)\n</code></pre>\n<p>assert len(os.listdir('../input/sartorius-cell-instance-segmentation/test'))==len(np.unique(image_names))</p>\n<p>pd.DataFrame({'id':image_names, 'predicted':pred_annots}).sort_values(['id']).to_csv('submission.csv', index=False)<br>\npd.read_csv('submission.csv').head(20)</p>\n<p>My output masks are pretty good but every time I make a submission, I get error (Notebook threw exception)<br>\nI have wasted many and many submissions<br>\nI hope anyone here can help me<br>\nIs it a memory problem????<br>\nThe notebook runs without errors but when running it to get the score, I got an error</p>",
      "rawMarkdown": "Hi everyone,\nI have used u2net for segmentation\nI used OpenCV to convert the output mask  to instance masks\nhere is the code I used for prediction\n\nimage_names, pred_annots = [],[]\nfor s in sub['id']:\n    img_name, prd=[],[]\n    image = load_img(os.path.join(test_fol, s)+'.png')\n    img = image.resize((256,256))\n    img = img_to_array(img)#.astype(np.int8)\n    img = np.expand_dims(img,axis=0)\n    results = model.predict(img)\n    results = np.squeeze(results)\n    frame= binarize(results[1,:,:], threshold = 0.5)\n    frame1 = np.reshape(frame,(256, 256))\n    frame2 = cv2.resize(frame1, (704,520), interpolation = cv2.INTER_AREA)\n   # plt.imshow(frame2)\n    frame3=post_process(frame2)\n    frame4=np.stack((frame3),axis=-1)\n    #print(frame3.shape)\n    if frame4.shape[-1]==0:\n        img_name.append(s)\n        prd.append('')\n    else:\n        if check_overlap(frame4): # if mask instances have overlap then fix it\n            print(\"Overlap Found!\")\n            frame4 = fix_overlap(frame4)\n        for r in range(frame4.shape[2]):\n            pred_mask = frame4[:, :, r]\n            pred_mask = pred_mask.astype(np.uint8)\n            \n            img_name.append(s)\n            prd.append(rle_encode(pred_mask))\n        \n    image_names.extend(img_name)\n    pred_annots.extend(prd)\n\nassert len(os.listdir('../input/sartorius-cell-instance-segmentation/test'))==len(np.unique(image_names))\n\npd.DataFrame({'id':image_names, 'predicted':pred_annots}).sort_values(['id']).to_csv('submission.csv', index=False)\npd.read_csv('submission.csv').head(20)\n\n\nMy output masks are pretty good but every time I make a submission, I get error (Notebook threw exception)\nI have wasted many and many submissions\nI hope anyone here can help me\nIs it a memory problem????\nThe notebook runs without errors but when running it to get the score, I got an error",
      "votes": null
    },
    {
      "id": "1604901",
      "postDate": "12/03/2021 20:47:10",
      "content": "<h6>######################  My logs</h6>\n<p>Successfully ran in 46.8s<br>\nAccelerator<br>\nNone<br>\nEnvironment<br>\nLatest Container Image<br>\nOutput<br>\n88.12 kB<br>\nTime<br>\n#<br>\nLog Message<br>\n13.7s    1   /opt/conda/lib/python3.7/site-packages/papermill/iorw.py:50: FutureWarning: pyarrow.HadoopFileSystem is deprecated as of 2.0.0, please use pyarrow.fs.HadoopFileSystem instead.<br>\n13.7s    2   from pyarrow import HadoopFileSystem<br>\n21.7s    3   <br>\n21.7s    4   User settings:<br>\n21.7s    5   <br>\n21.7s    6   KMP_AFFINITY=granularity=fine,verbose,compact,1,0<br>\n21.7s    7   KMP_BLOCKTIME=0<br>\n21.7s    8   KMP_DUPLICATE_LIB_OK=True<br>\n21.7s    9   KMP_INIT_AT_FORK=FALSE<br>\n21.7s    10  KMP_SETTINGS=1<br>\n21.7s    11  KMP_WARNINGS=0<br>\n21.7s    12  <br>\n21.7s    13  Effective settings:<br>\n21.7s    14  <br>\n21.7s    15  KMP_ABORT_DELAY=0<br>\n21.7s    16  KMP_ADAPTIVE_LOCK_PROPS='1,1024'<br>\n21.7s    17  KMP_ALIGN_ALLOC=64<br>\n21.7s    18  KMP_ALL_THREADPRIVATE=128<br>\n21.7s    19  KMP_ATOMIC_MODE=2<br>\n21.7s    20  KMP_BLOCKTIME=0<br>\n21.7s    21  KMP_CPUINFO_FILE: value is not defined<br>\n21.7s    22  KMP_DETERMINISTIC_REDUCTION=false<br>\n21.7s    23  KMP_DEVICE_THREAD_LIMIT=2147483647<br>\n21.7s    24  KMP_DISP_NUM_BUFFERS=7<br>\n21.7s    25  KMP_DUPLICATE_LIB_OK=true<br>\n21.7s    26  KMP_ENABLE_TASK_THROTTLING=true<br>\n21.7s    27  KMP_FORCE_REDUCTION: value is not defined<br>\n21.7s    28  KMP_FOREIGN_THREADS_THREADPRIVATE=true<br>\n21.7s    29  KMP_FORKJOIN_BARRIER='2,2'<br>\n21.7s    30  KMP_FORKJOIN_BARRIER_PATTERN='hyper,hyper'<br>\n21.7s    31  KMP_GTID_MODE=3<br>\n21.7s    32  KMP_HANDLE_SIGNALS=false<br>\n21.7s    33  KMP_HOT_TEAMS_MAX_LEVEL=1<br>\n21.7s    34  KMP_HOT_TEAMS_MODE=0<br>\n21.7s    35  KMP_INIT_AT_FORK=true<br>\n21.7s    36  KMP_LIBRARY=throughput<br>\n21.7s    37  KMP_LOCK_KIND=queuing<br>\n21.7s    38  KMP_MALLOC_POOL_INCR=1M<br>\n21.7s    39  KMP_NUM_LOCKS_IN_BLOCK=1<br>\n21.7s    40  KMP_PLAIN_BARRIER='2,2'<br>\n21.7s    41  KMP_PLAIN_BARRIER_PATTERN='hyper,hyper'<br>\n21.7s    42  KMP_REDUCTION_BARRIER='1,1'<br>\n21.7s    43  KMP_REDUCTION_BARRIER_PATTERN='hyper,hyper'<br>\n21.7s    44  KMP_SCHEDULE='static,balanced;guided,iterative'<br>\n21.7s    45  KMP_SETTINGS=true<br>\n21.7s    46  KMP_SPIN_BACKOFF_PARAMS='4096,100'<br>\n21.7s    47  KMP_STACKOFFSET=64<br>\n21.7s    48  KMP_STACKPAD=0<br>\n21.7s    49  KMP_STACKSIZE=8M<br>\n21.7s    50  KMP_STORAGE_MAP=false<br>\n21.7s    51  KMP_TASKING=2<br>\n21.7s    52  KMP_TASKLOOP_MIN_TASKS=0<br>\n21.7s    53  KMP_TASK_STEALING_CONSTRAINT=1<br>\n21.7s    54  KMP_TEAMS_THREAD_LIMIT=4<br>\n21.7s    55  KMP_TOPOLOGY_METHOD=all<br>\n21.7s    56  KMP_USE_YIELD=1<br>\n21.7s    57  KMP_VERSION=false<br>\n21.7s    58  KMP_WARNINGS=false<br>\n21.7s    59  OMP_AFFINITY_FORMAT='OMP: pid %P tid %i thread %n bound to OS proc set {%A}'<br>\n21.7s    60  OMP_ALLOCATOR=omp_default_mem_alloc<br>\n21.7s    61  OMP_CANCELLATION=false<br>\n21.7s    62  OMP_DEFAULT_DEVICE=0<br>\n21.7s    63  OMP_DISPLAY_AFFINITY=false<br>\n21.7s    64  OMP_DISPLAY_ENV=false<br>\n21.7s    65  OMP_DYNAMIC=false<br>\n21.7s    66  OMP_MAX_ACTIVE_LEVELS=1<br>\n21.7s    67  OMP_MAX_TASK_PRIORITY=0<br>\n21.7s    68  OMP_NESTED: deprecated; max-active-levels-var=1<br>\n21.7s    69  OMP_NUM_THREADS: value is not defined<br>\n21.7s    70  OMP_PLACES: value is not defined<br>\n21.7s    71  OMP_PROC_BIND='intel'<br>\n21.7s    72  OMP_SCHEDULE='static'<br>\n21.7s    73  OMP_STACKSIZE=8M<br>\n21.7s    74  OMP_TARGET_OFFLOAD=DEFAULT<br>\n21.7s    75  OMP_THREAD_LIMIT=2147483647<br>\n21.7s    76  OMP_WAIT_POLICY=PASSIVE<br>\n21.7s    77  KMP_AFFINITY='verbose,warnings,respect,granularity=fine,compact,1,0'<br>\n21.7s    78  <br>\n21.7s    79  2021-12-03 20:12:48.991474: I tensorflow/core/common_runtime/process_util.cc:146] Creating new thread pool with default inter op setting: 2. Tune using inter_op_parallelism_threads for best performance.<br>\n21.9s    80  <br>\n21.9s    81  User settings:<br>\n21.9s    82  <br>\n21.9s    83  KMP_AFFINITY=granularity=fine,verbose,compact,1,0<br>\n21.9s    84  KMP_BLOCKTIME=0<br>\n21.9s    85  KMP_DUPLICATE_LIB_OK=True<br>\n21.9s    86  KMP_INIT_AT_FORK=FALSE<br>\n21.9s    87  KMP_SETTINGS=1<br>\n21.9s    88  KMP_WARNINGS=0<br>\n21.9s    89  <br>\n21.9s    90  Effective settings:<br>\n21.9s    91  <br>\n21.9s    92  KMP_ABORT_DELAY=0<br>\n21.9s    93  KMP_ADAPTIVE_LOCK_PROPS='1,1024'<br>\n21.9s    94  KMP_ALIGN_ALLOC=64<br>\n21.9s    95  KMP_ALL_THREADPRIVATE=128<br>\n21.9s    96  KMP_ATOMIC_MODE=2<br>\n21.9s    97  KMP_BLOCKTIME=0<br>\n21.9s    98  KMP_CPUINFO_FILE: value is not defined<br>\n21.9s    99  KMP_DETERMINISTIC_REDUCTION=false<br>\n21.9s    100 KMP_DEVICE_THREAD_LIMIT=2147483647<br>\n21.9s    101 KMP_DISP_NUM_BUFFERS=7<br>\n21.9s    102 KMP_DUPLICATE_LIB_OK=true<br>\n21.9s    103 KMP_ENABLE_TASK_THROTTLING=true<br>\n21.9s    104 KMP_FORCE_REDUCTION: value is not defined<br>\n21.9s    105 KMP_FOREIGN_THREADS_THREADPRIVATE=true<br>\n21.9s    106 KMP_FORKJOIN_BARRIER='2,2'<br>\n21.9s    107 KMP_FORKJOIN_BARRIER_PATTERN='hyper,hyper'<br>\n21.9s    108 KMP_GTID_MODE=3<br>\n21.9s    109 KMP_HANDLE_SIGNALS=false<br>\n21.9s    110 KMP_HOT_TEAMS_MAX_LEVEL=1<br>\n21.9s    111 KMP_HOT_TEAMS_MODE=0<br>\n21.9s    112 KMP_INIT_AT_FORK=true<br>\n21.9s    113 KMP_LIBRARY=throughput<br>\n21.9s    114 KMP_LOCK_KIND=queuing<br>\n21.9s    115 KMP_MALLOC_POOL_INCR=1M<br>\n21.9s    116 KMP_NUM_LOCKS_IN_BLOCK=1<br>\n21.9s    117 KMP_PLAIN_BARRIER='2,2'<br>\n21.9s    118 KMP_PLAIN_BARRIER_PATTERN='hyper,hyper'<br>\n21.9s    119 KMP_REDUCTION_BARRIER='1,1'<br>\n21.9s    120 KMP_REDUCTION_BARRIER_PATTERN='hyper,hyper'<br>\n21.9s    121 KMP_SCHEDULE='static,balanced;guided,iterative'<br>\n21.9s    122 KMP_SETTINGS=true<br>\n21.9s    123 KMP_SPIN_BACKOFF_PARAMS='4096,100'<br>\n21.9s    124 KMP_STACKOFFSET=64<br>\n21.9s    125 KMP_STACKPAD=0<br>\n21.9s    126 KMP_STACKSIZE=8M<br>\n21.9s    127 KMP_STORAGE_MAP=false<br>\n21.9s    128 KMP_TASKING=2<br>\n21.9s    129 KMP_TASKLOOP_MIN_TASKS=0<br>\n21.9s    130 KMP_TASK_STEALING_CONSTRAINT=1<br>\n21.9s    131 KMP_TEAMS_THREAD_LIMIT=4<br>\n21.9s    132 KMP_TOPOLOGY_METHOD=all<br>\n21.9s    133 KMP_USE_YIELD=1<br>\n21.9s    134 KMP_VERSION=false<br>\n21.9s    135 KMP_WARNINGS=false<br>\n21.9s    136 OMP_AFFINITY_FORMAT='OMP: pid %P tid %i thread %n bound to OS proc set {%A}'<br>\n21.9s    137 OMP_ALLOCATOR=omp_default_mem_alloc<br>\n21.9s    138 OMP_CANCELLATION=false<br>\n21.9s    139 OMP_DEFAULT_DEVICE=0<br>\n21.9s    140 OMP_DISPLAY_AFFINITY=false<br>\n21.9s    141 OMP_DISPLAY_ENV=false<br>\n21.9s    142 OMP_DYNAMIC=false<br>\n21.9s    143 OMP_MAX_ACTIVE_LEVELS=1<br>\n21.9s    144 OMP_MAX_TASK_PRIORITY=0<br>\n21.9s    145 OMP_NESTED: deprecated; max-active-levels-var=1<br>\n21.9s    146 OMP_NUM_THREADS: value is not defined<br>\n21.9s    147 OMP_PLACES: value is not defined<br>\n21.9s    148 OMP_PROC_BIND='intel'<br>\n21.9s    149 OMP_SCHEDULE='static'<br>\n21.9s    150 OMP_STACKSIZE=8M<br>\n21.9s    151 OMP_TARGET_OFFLOAD=DEFAULT<br>\n21.9s    152 OMP_THREAD_LIMIT=2147483647<br>\n21.9s    153 OMP_WAIT_POLICY=PASSIVE<br>\n21.9s    154 KMP_AFFINITY='verbose,warnings,respect,granularity=fine,compact,1,0'<br>\n21.9s    155 <br>\n21.9s    156 2021-12-03 20:12:48.991474: I tensorflow/core/common_runtime/process_util.cc:146] Creating new thread pool with default inter op setting: 2. Tune using inter_op_parallelism_threads for best performance.<br>\n29.6s    157 2021-12-03 20:12:56.881931: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:185] None of the MLIR Optimization Passes are enabled (registered 2)<br>\n29.8s    158 2021-12-03 20:12:56.881931: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:185] None of the MLIR Optimization Passes are enabled (registered 2)<br>\n34.2s    159 99<br>\n35.8s    160 37<br>\n36.5s    161 36<br>\n43.0s    162 /opt/conda/lib/python3.7/site-packages/traitlets/traitlets.py:2567: FutureWarning: --Exporter.preprocessors=[\"remove_papermill_header.RemovePapermillHeader\"] for containers is deprecated in traitlets 5.0. You can pass <code>--Exporter.preprocessors item</code> … multiple times to add items to a list.<br>\n43.0s    163 FutureWarning,<br>\n43.0s    164 [NbConvertApp] Converting notebook <strong>notebook</strong>.ipynb to notebook<br>\n43.1s    165 [NbConvertApp] Writing 18672 bytes to <strong>notebook</strong>.ipynb<br>\n45.7s    166 /opt/conda/lib/python3.7/site-packages/traitlets/traitlets.py:2567: FutureWarning: --Exporter.preprocessors=[\"nbconvert.preprocessors.ExtractOutputPreprocessor\"] for containers is deprecated in traitlets 5.0. You can pass <code>--Exporter.preprocessors item</code> … multiple times to add items to a list.<br>\n45.7s    167 FutureWarning,<br>\n45.7s    168 [NbConvertApp] Converting notebook <strong>notebook</strong>.ipynb to html<br>\n46.6s    169 [NbConvertApp] Writing 303418 bytes to <strong>results</strong>.html</p>",
      "rawMarkdown": "############################  My logs###############################\n\nSuccessfully ran in 46.8s\nAccelerator\nNone\n\nEnvironment\nLatest Container Image\n\nOutput\n88.12 kB\n\nTime\n#\nLog Message\n13.7s\t1\t/opt/conda/lib/python3.7/site-packages/papermill/iorw.py:50: FutureWarning: pyarrow.HadoopFileSystem is deprecated as of 2.0.0, please use pyarrow.fs.HadoopFileSystem instead.\n13.7s\t2\tfrom pyarrow import HadoopFileSystem\n21.7s\t3\t\n21.7s\t4\tUser settings:\n21.7s\t5\t\n21.7s\t6\tKMP_AFFINITY=granularity=fine,verbose,compact,1,0\n21.7s\t7\tKMP_BLOCKTIME=0\n21.7s\t8\tKMP_DUPLICATE_LIB_OK=True\n21.7s\t9\tKMP_INIT_AT_FORK=FALSE\n21.7s\t10\tKMP_SETTINGS=1\n21.7s\t11\tKMP_WARNINGS=0\n21.7s\t12\t\n21.7s\t13\tEffective settings:\n21.7s\t14\t\n21.7s\t15\tKMP_ABORT_DELAY=0\n21.7s\t16\tKMP_ADAPTIVE_LOCK_PROPS='1,1024'\n21.7s\t17\tKMP_ALIGN_ALLOC=64\n21.7s\t18\tKMP_ALL_THREADPRIVATE=128\n21.7s\t19\tKMP_ATOMIC_MODE=2\n21.7s\t20\tKMP_BLOCKTIME=0\n21.7s\t21\tKMP_CPUINFO_FILE: value is not defined\n21.7s\t22\tKMP_DETERMINISTIC_REDUCTION=false\n21.7s\t23\tKMP_DEVICE_THREAD_LIMIT=2147483647\n21.7s\t24\tKMP_DISP_NUM_BUFFERS=7\n21.7s\t25\tKMP_DUPLICATE_LIB_OK=true\n21.7s\t26\tKMP_ENABLE_TASK_THROTTLING=true\n21.7s\t27\tKMP_FORCE_REDUCTION: value is not defined\n21.7s\t28\tKMP_FOREIGN_THREADS_THREADPRIVATE=true\n21.7s\t29\tKMP_FORKJOIN_BARRIER='2,2'\n21.7s\t30\tKMP_FORKJOIN_BARRIER_PATTERN='hyper,hyper'\n21.7s\t31\tKMP_GTID_MODE=3\n21.7s\t32\tKMP_HANDLE_SIGNALS=false\n21.7s\t33\tKMP_HOT_TEAMS_MAX_LEVEL=1\n21.7s\t34\tKMP_HOT_TEAMS_MODE=0\n21.7s\t35\tKMP_INIT_AT_FORK=true\n21.7s\t36\tKMP_LIBRARY=throughput\n21.7s\t37\tKMP_LOCK_KIND=queuing\n21.7s\t38\tKMP_MALLOC_POOL_INCR=1M\n21.7s\t39\tKMP_NUM_LOCKS_IN_BLOCK=1\n21.7s\t40\tKMP_PLAIN_BARRIER='2,2'\n21.7s\t41\tKMP_PLAIN_BARRIER_PATTERN='hyper,hyper'\n21.7s\t42\tKMP_REDUCTION_BARRIER='1,1'\n21.7s\t43\tKMP_REDUCTION_BARRIER_PATTERN='hyper,hyper'\n21.7s\t44\tKMP_SCHEDULE='static,balanced;guided,iterative'\n21.7s\t45\tKMP_SETTINGS=true\n21.7s\t46\tKMP_SPIN_BACKOFF_PARAMS='4096,100'\n21.7s\t47\tKMP_STACKOFFSET=64\n21.7s\t48\tKMP_STACKPAD=0\n21.7s\t49\tKMP_STACKSIZE=8M\n21.7s\t50\tKMP_STORAGE_MAP=false\n21.7s\t51\tKMP_TASKING=2\n21.7s\t52\tKMP_TASKLOOP_MIN_TASKS=0\n21.7s\t53\tKMP_TASK_STEALING_CONSTRAINT=1\n21.7s\t54\tKMP_TEAMS_THREAD_LIMIT=4\n21.7s\t55\tKMP_TOPOLOGY_METHOD=all\n21.7s\t56\tKMP_USE_YIELD=1\n21.7s\t57\tKMP_VERSION=false\n21.7s\t58\tKMP_WARNINGS=false\n21.7s\t59\tOMP_AFFINITY_FORMAT='OMP: pid %P tid %i thread %n bound to OS proc set {%A}'\n21.7s\t60\tOMP_ALLOCATOR=omp_default_mem_alloc\n21.7s\t61\tOMP_CANCELLATION=false\n21.7s\t62\tOMP_DEFAULT_DEVICE=0\n21.7s\t63\tOMP_DISPLAY_AFFINITY=false\n21.7s\t64\tOMP_DISPLAY_ENV=false\n21.7s\t65\tOMP_DYNAMIC=false\n21.7s\t66\tOMP_MAX_ACTIVE_LEVELS=1\n21.7s\t67\tOMP_MAX_TASK_PRIORITY=0\n21.7s\t68\tOMP_NESTED: deprecated; max-active-levels-var=1\n21.7s\t69\tOMP_NUM_THREADS: value is not defined\n21.7s\t70\tOMP_PLACES: value is not defined\n21.7s\t71\tOMP_PROC_BIND='intel'\n21.7s\t72\tOMP_SCHEDULE='static'\n21.7s\t73\tOMP_STACKSIZE=8M\n21.7s\t74\tOMP_TARGET_OFFLOAD=DEFAULT\n21.7s\t75\tOMP_THREAD_LIMIT=2147483647\n21.7s\t76\tOMP_WAIT_POLICY=PASSIVE\n21.7s\t77\tKMP_AFFINITY='verbose,warnings,respect,granularity=fine,compact,1,0'\n21.7s\t78\t\n21.7s\t79\t2021-12-03 20:12:48.991474: I tensorflow/core/common_runtime/process_util.cc:146] Creating new thread pool with default inter op setting: 2. Tune using inter_op_parallelism_threads for best performance.\n21.9s\t80\t\n21.9s\t81\tUser settings:\n21.9s\t82\t\n21.9s\t83\tKMP_AFFINITY=granularity=fine,verbose,compact,1,0\n21.9s\t84\tKMP_BLOCKTIME=0\n21.9s\t85\tKMP_DUPLICATE_LIB_OK=True\n21.9s\t86\tKMP_INIT_AT_FORK=FALSE\n21.9s\t87\tKMP_SETTINGS=1\n21.9s\t88\tKMP_WARNINGS=0\n21.9s\t89\t\n21.9s\t90\tEffective settings:\n21.9s\t91\t\n21.9s\t92\tKMP_ABORT_DELAY=0\n21.9s\t93\tKMP_ADAPTIVE_LOCK_PROPS='1,1024'\n21.9s\t94\tKMP_ALIGN_ALLOC=64\n21.9s\t95\tKMP_ALL_THREADPRIVATE=128\n21.9s\t96\tKMP_ATOMIC_MODE=2\n21.9s\t97\tKMP_BLOCKTIME=0\n21.9s\t98\tKMP_CPUINFO_FILE: value is not defined\n21.9s\t99\tKMP_DETERMINISTIC_REDUCTION=false\n21.9s\t100\tKMP_DEVICE_THREAD_LIMIT=2147483647\n21.9s\t101\tKMP_DISP_NUM_BUFFERS=7\n21.9s\t102\tKMP_DUPLICATE_LIB_OK=true\n21.9s\t103\tKMP_ENABLE_TASK_THROTTLING=true\n21.9s\t104\tKMP_FORCE_REDUCTION: value is not defined\n21.9s\t105\tKMP_FOREIGN_THREADS_THREADPRIVATE=true\n21.9s\t106\tKMP_FORKJOIN_BARRIER='2,2'\n21.9s\t107\tKMP_FORKJOIN_BARRIER_PATTERN='hyper,hyper'\n21.9s\t108\tKMP_GTID_MODE=3\n21.9s\t109\tKMP_HANDLE_SIGNALS=false\n21.9s\t110\tKMP_HOT_TEAMS_MAX_LEVEL=1\n21.9s\t111\tKMP_HOT_TEAMS_MODE=0\n21.9s\t112\tKMP_INIT_AT_FORK=true\n21.9s\t113\tKMP_LIBRARY=throughput\n21.9s\t114\tKMP_LOCK_KIND=queuing\n21.9s\t115\tKMP_MALLOC_POOL_INCR=1M\n21.9s\t116\tKMP_NUM_LOCKS_IN_BLOCK=1\n21.9s\t117\tKMP_PLAIN_BARRIER='2,2'\n21.9s\t118\tKMP_PLAIN_BARRIER_PATTERN='hyper,hyper'\n21.9s\t119\tKMP_REDUCTION_BARRIER='1,1'\n21.9s\t120\tKMP_REDUCTION_BARRIER_PATTERN='hyper,hyper'\n21.9s\t121\tKMP_SCHEDULE='static,balanced;guided,iterative'\n21.9s\t122\tKMP_SETTINGS=true\n21.9s\t123\tKMP_SPIN_BACKOFF_PARAMS='4096,100'\n21.9s\t124\tKMP_STACKOFFSET=64\n21.9s\t125\tKMP_STACKPAD=0\n21.9s\t126\tKMP_STACKSIZE=8M\n21.9s\t127\tKMP_STORAGE_MAP=false\n21.9s\t128\tKMP_TASKING=2\n21.9s\t129\tKMP_TASKLOOP_MIN_TASKS=0\n21.9s\t130\tKMP_TASK_STEALING_CONSTRAINT=1\n21.9s\t131\tKMP_TEAMS_THREAD_LIMIT=4\n21.9s\t132\tKMP_TOPOLOGY_METHOD=all\n21.9s\t133\tKMP_USE_YIELD=1\n21.9s\t134\tKMP_VERSION=false\n21.9s\t135\tKMP_WARNINGS=false\n21.9s\t136\tOMP_AFFINITY_FORMAT='OMP: pid %P tid %i thread %n bound to OS proc set {%A}'\n21.9s\t137\tOMP_ALLOCATOR=omp_default_mem_alloc\n21.9s\t138\tOMP_CANCELLATION=false\n21.9s\t139\tOMP_DEFAULT_DEVICE=0\n21.9s\t140\tOMP_DISPLAY_AFFINITY=false\n21.9s\t141\tOMP_DISPLAY_ENV=false\n21.9s\t142\tOMP_DYNAMIC=false\n21.9s\t143\tOMP_MAX_ACTIVE_LEVELS=1\n21.9s\t144\tOMP_MAX_TASK_PRIORITY=0\n21.9s\t145\tOMP_NESTED: deprecated; max-active-levels-var=1\n21.9s\t146\tOMP_NUM_THREADS: value is not defined\n21.9s\t147\tOMP_PLACES: value is not defined\n21.9s\t148\tOMP_PROC_BIND='intel'\n21.9s\t149\tOMP_SCHEDULE='static'\n21.9s\t150\tOMP_STACKSIZE=8M\n21.9s\t151\tOMP_TARGET_OFFLOAD=DEFAULT\n21.9s\t152\tOMP_THREAD_LIMIT=2147483647\n21.9s\t153\tOMP_WAIT_POLICY=PASSIVE\n21.9s\t154\tKMP_AFFINITY='verbose,warnings,respect,granularity=fine,compact,1,0'\n21.9s\t155\t\n21.9s\t156\t2021-12-03 20:12:48.991474: I tensorflow/core/common_runtime/process_util.cc:146] Creating new thread pool with default inter op setting: 2. Tune using inter_op_parallelism_threads for best performance.\n29.6s\t157\t2021-12-03 20:12:56.881931: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:185] None of the MLIR Optimization Passes are enabled (registered 2)\n29.8s\t158\t2021-12-03 20:12:56.881931: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:185] None of the MLIR Optimization Passes are enabled (registered 2)\n34.2s\t159\t99\n35.8s\t160\t37\n36.5s\t161\t36\n43.0s\t162\t/opt/conda/lib/python3.7/site-packages/traitlets/traitlets.py:2567: FutureWarning: --Exporter.preprocessors=[\"remove_papermill_header.RemovePapermillHeader\"] for containers is deprecated in traitlets 5.0. You can pass `--Exporter.preprocessors item` ... multiple times to add items to a list.\n43.0s\t163\tFutureWarning,\n43.0s\t164\t[NbConvertApp] Converting notebook __notebook__.ipynb to notebook\n43.1s\t165\t[NbConvertApp] Writing 18672 bytes to __notebook__.ipynb\n45.7s\t166\t/opt/conda/lib/python3.7/site-packages/traitlets/traitlets.py:2567: FutureWarning: --Exporter.preprocessors=[\"nbconvert.preprocessors.ExtractOutputPreprocessor\"] for containers is deprecated in traitlets 5.0. You can pass `--Exporter.preprocessors item` ... multiple times to add items to a list.\n45.7s\t167\tFutureWarning,\n45.7s\t168\t[NbConvertApp] Converting notebook __notebook__.ipynb to html\n46.6s\t169\t[NbConvertApp] Writing 303418 bytes to __results__.html",
      "votes": null
    },
    {
      "id": "1605294",
      "postDate": "12/04/2021 05:58:21",
      "content": "<p><a href=\"https://www.kaggle.com/awsaf49\" target=\"_blank\">@awsaf49</a> ,could you kindly help me with this issue?</p>",
      "rawMarkdown": "awsaf49 ,could you kindly help me with this issue?",
      "votes": null
    },
    {
      "id": "1605440",
      "postDate": "12/04/2021 08:16:25",
      "content": "<p>I have published a notebook with my version of the submission scoring error correction. see if it can help you.<br>\nit is called: submission scoring error fix</p>",
      "rawMarkdown": "I have published a notebook with my version of the submission scoring error correction. see if it can help you.\nit is called: submission scoring error fix",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1604901,
      "author_name": "fatmamazen",
      "author_url": "",
      "post_date": "12/03/2021 20:47:10",
      "content": "<h6>######################  My logs</h6>\n<p>Successfully ran in 46.8s<br>\nAccelerator<br>\nNone<br>\nEnvironment<br>\nLatest Container Image<br>\nOutput<br>\n88.12 kB<br>\nTime<br>\n#<br>\nLog Message<br>\n13.7s    1   /opt/conda/lib/python3.7/site-packages/papermill/iorw.py:50: FutureWarning: pyarrow.HadoopFileSystem is deprecated as of 2.0.0, please use pyarrow.fs.HadoopFileSystem instead.<br>\n13.7s    2   from pyarrow import HadoopFileSystem<br>\n21.7s    3   <br>\n21.7s    4   User settings:<br>\n21.7s    5   <br>\n21.7s    6   KMP_AFFINITY=granularity=fine,verbose,compact,1,0<br>\n21.7s    7   KMP_BLOCKTIME=0<br>\n21.7s    8   KMP_DUPLICATE_LIB_OK=True<br>\n21.7s    9   KMP_INIT_AT_FORK=FALSE<br>\n21.7s    10  KMP_SETTINGS=1<br>\n21.7s    11  KMP_WARNINGS=0<br>\n21.7s    12  <br>\n21.7s    13  Effective settings:<br>\n21.7s    14  <br>\n21.7s    15  KMP_ABORT_DELAY=0<br>\n21.7s    16  KMP_ADAPTIVE_LOCK_PROPS='1,1024'<br>\n21.7s    17  KMP_ALIGN_ALLOC=64<br>\n21.7s    18  KMP_ALL_THREADPRIVATE=128<br>\n21.7s    19  KMP_ATOMIC_MODE=2<br>\n21.7s    20  KMP_BLOCKTIME=0<br>\n21.7s    21  KMP_CPUINFO_FILE: value is not defined<br>\n21.7s    22  KMP_DETERMINISTIC_REDUCTION=false<br>\n21.7s    23  KMP_DEVICE_THREAD_LIMIT=2147483647<br>\n21.7s    24  KMP_DISP_NUM_BUFFERS=7<br>\n21.7s    25  KMP_DUPLICATE_LIB_OK=true<br>\n21.7s    26  KMP_ENABLE_TASK_THROTTLING=true<br>\n21.7s    27  KMP_FORCE_REDUCTION: value is not defined<br>\n21.7s    28  KMP_FOREIGN_THREADS_THREADPRIVATE=true<br>\n21.7s    29  KMP_FORKJOIN_BARRIER='2,2'<br>\n21.7s    30  KMP_FORKJOIN_BARRIER_PATTERN='hyper,hyper'<br>\n21.7s    31  KMP_GTID_MODE=3<br>\n21.7s    32  KMP_HANDLE_SIGNALS=false<br>\n21.7s    33  KMP_HOT_TEAMS_MAX_LEVEL=1<br>\n21.7s    34  KMP_HOT_TEAMS_MODE=0<br>\n21.7s    35  KMP_INIT_AT_FORK=true<br>\n21.7s    36  KMP_LIBRARY=throughput<br>\n21.7s    37  KMP_LOCK_KIND=queuing<br>\n21.7s    38  KMP_MALLOC_POOL_INCR=1M<br>\n21.7s    39  KMP_NUM_LOCKS_IN_BLOCK=1<br>\n21.7s    40  KMP_PLAIN_BARRIER='2,2'<br>\n21.7s    41  KMP_PLAIN_BARRIER_PATTERN='hyper,hyper'<br>\n21.7s    42  KMP_REDUCTION_BARRIER='1,1'<br>\n21.7s    43  KMP_REDUCTION_BARRIER_PATTERN='hyper,hyper'<br>\n21.7s    44  KMP_SCHEDULE='static,balanced;guided,iterative'<br>\n21.7s    45  KMP_SETTINGS=true<br>\n21.7s    46  KMP_SPIN_BACKOFF_PARAMS='4096,100'<br>\n21.7s    47  KMP_STACKOFFSET=64<br>\n21.7s    48  KMP_STACKPAD=0<br>\n21.7s    49  KMP_STACKSIZE=8M<br>\n21.7s    50  KMP_STORAGE_MAP=false<br>\n21.7s    51  KMP_TASKING=2<br>\n21.7s    52  KMP_TASKLOOP_MIN_TASKS=0<br>\n21.7s    53  KMP_TASK_STEALING_CONSTRAINT=1<br>\n21.7s    54  KMP_TEAMS_THREAD_LIMIT=4<br>\n21.7s    55  KMP_TOPOLOGY_METHOD=all<br>\n21.7s    56  KMP_USE_YIELD=1<br>\n21.7s    57  KMP_VERSION=false<br>\n21.7s    58  KMP_WARNINGS=false<br>\n21.7s    59  OMP_AFFINITY_FORMAT='OMP: pid %P tid %i thread %n bound to OS proc set {%A}'<br>\n21.7s    60  OMP_ALLOCATOR=omp_default_mem_alloc<br>\n21.7s    61  OMP_CANCELLATION=false<br>\n21.7s    62  OMP_DEFAULT_DEVICE=0<br>\n21.7s    63  OMP_DISPLAY_AFFINITY=false<br>\n21.7s    64  OMP_DISPLAY_ENV=false<br>\n21.7s    65  OMP_DYNAMIC=false<br>\n21.7s    66  OMP_MAX_ACTIVE_LEVELS=1<br>\n21.7s    67  OMP_MAX_TASK_PRIORITY=0<br>\n21.7s    68  OMP_NESTED: deprecated; max-active-levels-var=1<br>\n21.7s    69  OMP_NUM_THREADS: value is not defined<br>\n21.7s    70  OMP_PLACES: value is not defined<br>\n21.7s    71  OMP_PROC_BIND='intel'<br>\n21.7s    72  OMP_SCHEDULE='static'<br>\n21.7s    73  OMP_STACKSIZE=8M<br>\n21.7s    74  OMP_TARGET_OFFLOAD=DEFAULT<br>\n21.7s    75  OMP_THREAD_LIMIT=2147483647<br>\n21.7s    76  OMP_WAIT_POLICY=PASSIVE<br>\n21.7s    77  KMP_AFFINITY='verbose,warnings,respect,granularity=fine,compact,1,0'<br>\n21.7s    78  <br>\n21.7s    79  2021-12-03 20:12:48.991474: I tensorflow/core/common_runtime/process_util.cc:146] Creating new thread pool with default inter op setting: 2. Tune using inter_op_parallelism_threads for best performance.<br>\n21.9s    80  <br>\n21.9s    81  User settings:<br>\n21.9s    82  <br>\n21.9s    83  KMP_AFFINITY=granularity=fine,verbose,compact,1,0<br>\n21.9s    84  KMP_BLOCKTIME=0<br>\n21.9s    85  KMP_DUPLICATE_LIB_OK=True<br>\n21.9s    86  KMP_INIT_AT_FORK=FALSE<br>\n21.9s    87  KMP_SETTINGS=1<br>\n21.9s    88  KMP_WARNINGS=0<br>\n21.9s    89  <br>\n21.9s    90  Effective settings:<br>\n21.9s    91  <br>\n21.9s    92  KMP_ABORT_DELAY=0<br>\n21.9s    93  KMP_ADAPTIVE_LOCK_PROPS='1,1024'<br>\n21.9s    94  KMP_ALIGN_ALLOC=64<br>\n21.9s    95  KMP_ALL_THREADPRIVATE=128<br>\n21.9s    96  KMP_ATOMIC_MODE=2<br>\n21.9s    97  KMP_BLOCKTIME=0<br>\n21.9s    98  KMP_CPUINFO_FILE: value is not defined<br>\n21.9s    99  KMP_DETERMINISTIC_REDUCTION=false<br>\n21.9s    100 KMP_DEVICE_THREAD_LIMIT=2147483647<br>\n21.9s    101 KMP_DISP_NUM_BUFFERS=7<br>\n21.9s    102 KMP_DUPLICATE_LIB_OK=true<br>\n21.9s    103 KMP_ENABLE_TASK_THROTTLING=true<br>\n21.9s    104 KMP_FORCE_REDUCTION: value is not defined<br>\n21.9s    105 KMP_FOREIGN_THREADS_THREADPRIVATE=true<br>\n21.9s    106 KMP_FORKJOIN_BARRIER='2,2'<br>\n21.9s    107 KMP_FORKJOIN_BARRIER_PATTERN='hyper,hyper'<br>\n21.9s    108 KMP_GTID_MODE=3<br>\n21.9s    109 KMP_HANDLE_SIGNALS=false<br>\n21.9s    110 KMP_HOT_TEAMS_MAX_LEVEL=1<br>\n21.9s    111 KMP_HOT_TEAMS_MODE=0<br>\n21.9s    112 KMP_INIT_AT_FORK=true<br>\n21.9s    113 KMP_LIBRARY=throughput<br>\n21.9s    114 KMP_LOCK_KIND=queuing<br>\n21.9s    115 KMP_MALLOC_POOL_INCR=1M<br>\n21.9s    116 KMP_NUM_LOCKS_IN_BLOCK=1<br>\n21.9s    117 KMP_PLAIN_BARRIER='2,2'<br>\n21.9s    118 KMP_PLAIN_BARRIER_PATTERN='hyper,hyper'<br>\n21.9s    119 KMP_REDUCTION_BARRIER='1,1'<br>\n21.9s    120 KMP_REDUCTION_BARRIER_PATTERN='hyper,hyper'<br>\n21.9s    121 KMP_SCHEDULE='static,balanced;guided,iterative'<br>\n21.9s    122 KMP_SETTINGS=true<br>\n21.9s    123 KMP_SPIN_BACKOFF_PARAMS='4096,100'<br>\n21.9s    124 KMP_STACKOFFSET=64<br>\n21.9s    125 KMP_STACKPAD=0<br>\n21.9s    126 KMP_STACKSIZE=8M<br>\n21.9s    127 KMP_STORAGE_MAP=false<br>\n21.9s    128 KMP_TASKING=2<br>\n21.9s    129 KMP_TASKLOOP_MIN_TASKS=0<br>\n21.9s    130 KMP_TASK_STEALING_CONSTRAINT=1<br>\n21.9s    131 KMP_TEAMS_THREAD_LIMIT=4<br>\n21.9s    132 KMP_TOPOLOGY_METHOD=all<br>\n21.9s    133 KMP_USE_YIELD=1<br>\n21.9s    134 KMP_VERSION=false<br>\n21.9s    135 KMP_WARNINGS=false<br>\n21.9s    136 OMP_AFFINITY_FORMAT='OMP: pid %P tid %i thread %n bound to OS proc set {%A}'<br>\n21.9s    137 OMP_ALLOCATOR=omp_default_mem_alloc<br>\n21.9s    138 OMP_CANCELLATION=false<br>\n21.9s    139 OMP_DEFAULT_DEVICE=0<br>\n21.9s    140 OMP_DISPLAY_AFFINITY=false<br>\n21.9s    141 OMP_DISPLAY_ENV=false<br>\n21.9s    142 OMP_DYNAMIC=false<br>\n21.9s    143 OMP_MAX_ACTIVE_LEVELS=1<br>\n21.9s    144 OMP_MAX_TASK_PRIORITY=0<br>\n21.9s    145 OMP_NESTED: deprecated; max-active-levels-var=1<br>\n21.9s    146 OMP_NUM_THREADS: value is not defined<br>\n21.9s    147 OMP_PLACES: value is not defined<br>\n21.9s    148 OMP_PROC_BIND='intel'<br>\n21.9s    149 OMP_SCHEDULE='static'<br>\n21.9s    150 OMP_STACKSIZE=8M<br>\n21.9s    151 OMP_TARGET_OFFLOAD=DEFAULT<br>\n21.9s    152 OMP_THREAD_LIMIT=2147483647<br>\n21.9s    153 OMP_WAIT_POLICY=PASSIVE<br>\n21.9s    154 KMP_AFFINITY='verbose,warnings,respect,granularity=fine,compact,1,0'<br>\n21.9s    155 <br>\n21.9s    156 2021-12-03 20:12:48.991474: I tensorflow/core/common_runtime/process_util.cc:146] Creating new thread pool with default inter op setting: 2. Tune using inter_op_parallelism_threads for best performance.<br>\n29.6s    157 2021-12-03 20:12:56.881931: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:185] None of the MLIR Optimization Passes are enabled (registered 2)<br>\n29.8s    158 2021-12-03 20:12:56.881931: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:185] None of the MLIR Optimization Passes are enabled (registered 2)<br>\n34.2s    159 99<br>\n35.8s    160 37<br>\n36.5s    161 36<br>\n43.0s    162 /opt/conda/lib/python3.7/site-packages/traitlets/traitlets.py:2567: FutureWarning: --Exporter.preprocessors=[\"remove_papermill_header.RemovePapermillHeader\"] for containers is deprecated in traitlets 5.0. You can pass <code>--Exporter.preprocessors item</code> … multiple times to add items to a list.<br>\n43.0s    163 FutureWarning,<br>\n43.0s    164 [NbConvertApp] Converting notebook <strong>notebook</strong>.ipynb to notebook<br>\n43.1s    165 [NbConvertApp] Writing 18672 bytes to <strong>notebook</strong>.ipynb<br>\n45.7s    166 /opt/conda/lib/python3.7/site-packages/traitlets/traitlets.py:2567: FutureWarning: --Exporter.preprocessors=[\"nbconvert.preprocessors.ExtractOutputPreprocessor\"] for containers is deprecated in traitlets 5.0. You can pass <code>--Exporter.preprocessors item</code> … multiple times to add items to a list.<br>\n45.7s    167 FutureWarning,<br>\n45.7s    168 [NbConvertApp] Converting notebook <strong>notebook</strong>.ipynb to html<br>\n46.6s    169 [NbConvertApp] Writing 303418 bytes to <strong>results</strong>.html</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1605294,
      "author_name": "fatmamazen",
      "author_url": "",
      "post_date": "12/04/2021 05:58:21",
      "content": "<p><a href=\"https://www.kaggle.com/awsaf49\" target=\"_blank\">@awsaf49</a> ,could you kindly help me with this issue?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1605440,
      "author_name": "zaakciiru",
      "author_url": "",
      "post_date": "12/04/2021 08:16:25",
      "content": "<p>I have published a notebook with my version of the submission scoring error correction. see if it can help you.<br>\nit is called: submission scoring error fix</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1604899": "Hi everyone,\nI have used u2net for segmentation\nI used OpenCV to convert the output mask  to instance masks\nhere is the code I used for prediction\n\nimage_names, pred_annots = [],[]\nfor s in sub['id']:\n    img_name, prd=[],[]\n    image = load_img(os.path.join(test_fol, s)+'.png')\n    img = image.resize((256,256))\n    img = img_to_array(img)#.astype(np.int8)\n    img = np.expand_dims(img,axis=0)\n    results = model.predict(img)\n    results = np.squeeze(results)\n    frame= binarize(results[1,:,:], threshold = 0.5)\n    frame1 = np.reshape(frame,(256, 256))\n    frame2 = cv2.resize(frame1, (704,520), interpolation = cv2.INTER_AREA)\n   # plt.imshow(frame2)\n    frame3=post_process(frame2)\n    frame4=np.stack((frame3),axis=-1)\n    #print(frame3.shape)\n    if frame4.shape[-1]==0:\n        img_name.append(s)\n        prd.append('')\n    else:\n        if check_overlap(frame4): # if mask instances have overlap then fix it\n            print(\"Overlap Found!\")\n            frame4 = fix_overlap(frame4)\n        for r in range(frame4.shape[2]):\n            pred_mask = frame4[:, :, r]\n            pred_mask = pred_mask.astype(np.uint8)\n            \n            img_name.append(s)\n            prd.append(rle_encode(pred_mask))\n        \n    image_names.extend(img_name)\n    pred_annots.extend(prd)\n\nassert len(os.listdir('../input/sartorius-cell-instance-segmentation/test'))==len(np.unique(image_names))\n\npd.DataFrame({'id':image_names, 'predicted':pred_annots}).sort_values(['id']).to_csv('submission.csv', index=False)\npd.read_csv('submission.csv').head(20)\n\n\nMy output masks are pretty good but every time I make a submission, I get error (Notebook threw exception)\nI have wasted many and many submissions\nI hope anyone here can help me\nIs it a memory problem????\nThe notebook runs without errors but when running it to get the score, I got an error",
    "1604901": "############################  My logs###############################\n\nSuccessfully ran in 46.8s\nAccelerator\nNone\n\nEnvironment\nLatest Container Image\n\nOutput\n88.12 kB\n\nTime\n#\nLog Message\n13.7s\t1\t/opt/conda/lib/python3.7/site-packages/papermill/iorw.py:50: FutureWarning: pyarrow.HadoopFileSystem is deprecated as of 2.0.0, please use pyarrow.fs.HadoopFileSystem instead.\n13.7s\t2\tfrom pyarrow import HadoopFileSystem\n21.7s\t3\t\n21.7s\t4\tUser settings:\n21.7s\t5\t\n21.7s\t6\tKMP_AFFINITY=granularity=fine,verbose,compact,1,0\n21.7s\t7\tKMP_BLOCKTIME=0\n21.7s\t8\tKMP_DUPLICATE_LIB_OK=True\n21.7s\t9\tKMP_INIT_AT_FORK=FALSE\n21.7s\t10\tKMP_SETTINGS=1\n21.7s\t11\tKMP_WARNINGS=0\n21.7s\t12\t\n21.7s\t13\tEffective settings:\n21.7s\t14\t\n21.7s\t15\tKMP_ABORT_DELAY=0\n21.7s\t16\tKMP_ADAPTIVE_LOCK_PROPS='1,1024'\n21.7s\t17\tKMP_ALIGN_ALLOC=64\n21.7s\t18\tKMP_ALL_THREADPRIVATE=128\n21.7s\t19\tKMP_ATOMIC_MODE=2\n21.7s\t20\tKMP_BLOCKTIME=0\n21.7s\t21\tKMP_CPUINFO_FILE: value is not defined\n21.7s\t22\tKMP_DETERMINISTIC_REDUCTION=false\n21.7s\t23\tKMP_DEVICE_THREAD_LIMIT=2147483647\n21.7s\t24\tKMP_DISP_NUM_BUFFERS=7\n21.7s\t25\tKMP_DUPLICATE_LIB_OK=true\n21.7s\t26\tKMP_ENABLE_TASK_THROTTLING=true\n21.7s\t27\tKMP_FORCE_REDUCTION: value is not defined\n21.7s\t28\tKMP_FOREIGN_THREADS_THREADPRIVATE=true\n21.7s\t29\tKMP_FORKJOIN_BARRIER='2,2'\n21.7s\t30\tKMP_FORKJOIN_BARRIER_PATTERN='hyper,hyper'\n21.7s\t31\tKMP_GTID_MODE=3\n21.7s\t32\tKMP_HANDLE_SIGNALS=false\n21.7s\t33\tKMP_HOT_TEAMS_MAX_LEVEL=1\n21.7s\t34\tKMP_HOT_TEAMS_MODE=0\n21.7s\t35\tKMP_INIT_AT_FORK=true\n21.7s\t36\tKMP_LIBRARY=throughput\n21.7s\t37\tKMP_LOCK_KIND=queuing\n21.7s\t38\tKMP_MALLOC_POOL_INCR=1M\n21.7s\t39\tKMP_NUM_LOCKS_IN_BLOCK=1\n21.7s\t40\tKMP_PLAIN_BARRIER='2,2'\n21.7s\t41\tKMP_PLAIN_BARRIER_PATTERN='hyper,hyper'\n21.7s\t42\tKMP_REDUCTION_BARRIER='1,1'\n21.7s\t43\tKMP_REDUCTION_BARRIER_PATTERN='hyper,hyper'\n21.7s\t44\tKMP_SCHEDULE='static,balanced;guided,iterative'\n21.7s\t45\tKMP_SETTINGS=true\n21.7s\t46\tKMP_SPIN_BACKOFF_PARAMS='4096,100'\n21.7s\t47\tKMP_STACKOFFSET=64\n21.7s\t48\tKMP_STACKPAD=0\n21.7s\t49\tKMP_STACKSIZE=8M\n21.7s\t50\tKMP_STORAGE_MAP=false\n21.7s\t51\tKMP_TASKING=2\n21.7s\t52\tKMP_TASKLOOP_MIN_TASKS=0\n21.7s\t53\tKMP_TASK_STEALING_CONSTRAINT=1\n21.7s\t54\tKMP_TEAMS_THREAD_LIMIT=4\n21.7s\t55\tKMP_TOPOLOGY_METHOD=all\n21.7s\t56\tKMP_USE_YIELD=1\n21.7s\t57\tKMP_VERSION=false\n21.7s\t58\tKMP_WARNINGS=false\n21.7s\t59\tOMP_AFFINITY_FORMAT='OMP: pid %P tid %i thread %n bound to OS proc set {%A}'\n21.7s\t60\tOMP_ALLOCATOR=omp_default_mem_alloc\n21.7s\t61\tOMP_CANCELLATION=false\n21.7s\t62\tOMP_DEFAULT_DEVICE=0\n21.7s\t63\tOMP_DISPLAY_AFFINITY=false\n21.7s\t64\tOMP_DISPLAY_ENV=false\n21.7s\t65\tOMP_DYNAMIC=false\n21.7s\t66\tOMP_MAX_ACTIVE_LEVELS=1\n21.7s\t67\tOMP_MAX_TASK_PRIORITY=0\n21.7s\t68\tOMP_NESTED: deprecated; max-active-levels-var=1\n21.7s\t69\tOMP_NUM_THREADS: value is not defined\n21.7s\t70\tOMP_PLACES: value is not defined\n21.7s\t71\tOMP_PROC_BIND='intel'\n21.7s\t72\tOMP_SCHEDULE='static'\n21.7s\t73\tOMP_STACKSIZE=8M\n21.7s\t74\tOMP_TARGET_OFFLOAD=DEFAULT\n21.7s\t75\tOMP_THREAD_LIMIT=2147483647\n21.7s\t76\tOMP_WAIT_POLICY=PASSIVE\n21.7s\t77\tKMP_AFFINITY='verbose,warnings,respect,granularity=fine,compact,1,0'\n21.7s\t78\t\n21.7s\t79\t2021-12-03 20:12:48.991474: I tensorflow/core/common_runtime/process_util.cc:146] Creating new thread pool with default inter op setting: 2. Tune using inter_op_parallelism_threads for best performance.\n21.9s\t80\t\n21.9s\t81\tUser settings:\n21.9s\t82\t\n21.9s\t83\tKMP_AFFINITY=granularity=fine,verbose,compact,1,0\n21.9s\t84\tKMP_BLOCKTIME=0\n21.9s\t85\tKMP_DUPLICATE_LIB_OK=True\n21.9s\t86\tKMP_INIT_AT_FORK=FALSE\n21.9s\t87\tKMP_SETTINGS=1\n21.9s\t88\tKMP_WARNINGS=0\n21.9s\t89\t\n21.9s\t90\tEffective settings:\n21.9s\t91\t\n21.9s\t92\tKMP_ABORT_DELAY=0\n21.9s\t93\tKMP_ADAPTIVE_LOCK_PROPS='1,1024'\n21.9s\t94\tKMP_ALIGN_ALLOC=64\n21.9s\t95\tKMP_ALL_THREADPRIVATE=128\n21.9s\t96\tKMP_ATOMIC_MODE=2\n21.9s\t97\tKMP_BLOCKTIME=0\n21.9s\t98\tKMP_CPUINFO_FILE: value is not defined\n21.9s\t99\tKMP_DETERMINISTIC_REDUCTION=false\n21.9s\t100\tKMP_DEVICE_THREAD_LIMIT=2147483647\n21.9s\t101\tKMP_DISP_NUM_BUFFERS=7\n21.9s\t102\tKMP_DUPLICATE_LIB_OK=true\n21.9s\t103\tKMP_ENABLE_TASK_THROTTLING=true\n21.9s\t104\tKMP_FORCE_REDUCTION: value is not defined\n21.9s\t105\tKMP_FOREIGN_THREADS_THREADPRIVATE=true\n21.9s\t106\tKMP_FORKJOIN_BARRIER='2,2'\n21.9s\t107\tKMP_FORKJOIN_BARRIER_PATTERN='hyper,hyper'\n21.9s\t108\tKMP_GTID_MODE=3\n21.9s\t109\tKMP_HANDLE_SIGNALS=false\n21.9s\t110\tKMP_HOT_TEAMS_MAX_LEVEL=1\n21.9s\t111\tKMP_HOT_TEAMS_MODE=0\n21.9s\t112\tKMP_INIT_AT_FORK=true\n21.9s\t113\tKMP_LIBRARY=throughput\n21.9s\t114\tKMP_LOCK_KIND=queuing\n21.9s\t115\tKMP_MALLOC_POOL_INCR=1M\n21.9s\t116\tKMP_NUM_LOCKS_IN_BLOCK=1\n21.9s\t117\tKMP_PLAIN_BARRIER='2,2'\n21.9s\t118\tKMP_PLAIN_BARRIER_PATTERN='hyper,hyper'\n21.9s\t119\tKMP_REDUCTION_BARRIER='1,1'\n21.9s\t120\tKMP_REDUCTION_BARRIER_PATTERN='hyper,hyper'\n21.9s\t121\tKMP_SCHEDULE='static,balanced;guided,iterative'\n21.9s\t122\tKMP_SETTINGS=true\n21.9s\t123\tKMP_SPIN_BACKOFF_PARAMS='4096,100'\n21.9s\t124\tKMP_STACKOFFSET=64\n21.9s\t125\tKMP_STACKPAD=0\n21.9s\t126\tKMP_STACKSIZE=8M\n21.9s\t127\tKMP_STORAGE_MAP=false\n21.9s\t128\tKMP_TASKING=2\n21.9s\t129\tKMP_TASKLOOP_MIN_TASKS=0\n21.9s\t130\tKMP_TASK_STEALING_CONSTRAINT=1\n21.9s\t131\tKMP_TEAMS_THREAD_LIMIT=4\n21.9s\t132\tKMP_TOPOLOGY_METHOD=all\n21.9s\t133\tKMP_USE_YIELD=1\n21.9s\t134\tKMP_VERSION=false\n21.9s\t135\tKMP_WARNINGS=false\n21.9s\t136\tOMP_AFFINITY_FORMAT='OMP: pid %P tid %i thread %n bound to OS proc set {%A}'\n21.9s\t137\tOMP_ALLOCATOR=omp_default_mem_alloc\n21.9s\t138\tOMP_CANCELLATION=false\n21.9s\t139\tOMP_DEFAULT_DEVICE=0\n21.9s\t140\tOMP_DISPLAY_AFFINITY=false\n21.9s\t141\tOMP_DISPLAY_ENV=false\n21.9s\t142\tOMP_DYNAMIC=false\n21.9s\t143\tOMP_MAX_ACTIVE_LEVELS=1\n21.9s\t144\tOMP_MAX_TASK_PRIORITY=0\n21.9s\t145\tOMP_NESTED: deprecated; max-active-levels-var=1\n21.9s\t146\tOMP_NUM_THREADS: value is not defined\n21.9s\t147\tOMP_PLACES: value is not defined\n21.9s\t148\tOMP_PROC_BIND='intel'\n21.9s\t149\tOMP_SCHEDULE='static'\n21.9s\t150\tOMP_STACKSIZE=8M\n21.9s\t151\tOMP_TARGET_OFFLOAD=DEFAULT\n21.9s\t152\tOMP_THREAD_LIMIT=2147483647\n21.9s\t153\tOMP_WAIT_POLICY=PASSIVE\n21.9s\t154\tKMP_AFFINITY='verbose,warnings,respect,granularity=fine,compact,1,0'\n21.9s\t155\t\n21.9s\t156\t2021-12-03 20:12:48.991474: I tensorflow/core/common_runtime/process_util.cc:146] Creating new thread pool with default inter op setting: 2. Tune using inter_op_parallelism_threads for best performance.\n29.6s\t157\t2021-12-03 20:12:56.881931: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:185] None of the MLIR Optimization Passes are enabled (registered 2)\n29.8s\t158\t2021-12-03 20:12:56.881931: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:185] None of the MLIR Optimization Passes are enabled (registered 2)\n34.2s\t159\t99\n35.8s\t160\t37\n36.5s\t161\t36\n43.0s\t162\t/opt/conda/lib/python3.7/site-packages/traitlets/traitlets.py:2567: FutureWarning: --Exporter.preprocessors=[\"remove_papermill_header.RemovePapermillHeader\"] for containers is deprecated in traitlets 5.0. You can pass `--Exporter.preprocessors item` ... multiple times to add items to a list.\n43.0s\t163\tFutureWarning,\n43.0s\t164\t[NbConvertApp] Converting notebook __notebook__.ipynb to notebook\n43.1s\t165\t[NbConvertApp] Writing 18672 bytes to __notebook__.ipynb\n45.7s\t166\t/opt/conda/lib/python3.7/site-packages/traitlets/traitlets.py:2567: FutureWarning: --Exporter.preprocessors=[\"nbconvert.preprocessors.ExtractOutputPreprocessor\"] for containers is deprecated in traitlets 5.0. You can pass `--Exporter.preprocessors item` ... multiple times to add items to a list.\n45.7s\t167\tFutureWarning,\n45.7s\t168\t[NbConvertApp] Converting notebook __notebook__.ipynb to html\n46.6s\t169\t[NbConvertApp] Writing 303418 bytes to __results__.html",
    "1605294": "awsaf49 ,could you kindly help me with this issue?",
    "1605440": "I have published a notebook with my version of the submission scoring error correction. see if it can help you.\nit is called: submission scoring error fix"
  },
  "source": "meta"
}