{
  "id": 583872,
  "title": "Epoch Train/CV scores of all datasets [Can we break Bartley's strong models]",
  "url": "/competitions/waveform-inversion/discussion/583872",
  "author_name": "SeshuRaju 🧘‍♂️",
  "post_date": "2025-06-10T05:45:17.370000",
  "votes": 6,
  "comment_count": 9,
  "views": 0,
  "content": "<blockquote>\n  <p>As, training taking too long -&gt; 8 days for 150 epochs (from past discussions), i'm sharing my current training log as follow</p>\n</blockquote>\n<hr>\n<table>\n<thead>\n<tr>\n<th>Epoch</th>\n<th>Train</th>\n<th>CV</th>\n</tr>\n</thead>\n<tbody>\n<tr>\n<td>14</td>\n<td>37.9</td>\n<td>33.3</td>\n</tr>\n<tr>\n<td>17</td>\n<td>36.0</td>\n<td>32.7</td>\n</tr>\n<tr>\n<td>18</td>\n<td>35.4</td>\n<td>31.5</td>\n</tr>\n<tr>\n<td>19</td>\n<td>34.9</td>\n<td>34.0</td>\n</tr>\n<tr>\n<td>20</td>\n<td>34.5</td>\n<td>31.5</td>\n</tr>\n<tr>\n<td>Testing different models for 20 epochs</td>\n<td></td>\n<td></td>\n</tr>\n</tbody>\n</table>",
  "messages": [
    {
      "id": 3220894,
      "postDate": "2025-06-10T05:45:17.370Z",
      "content": "<blockquote>\n  <p>As, training taking too long -&gt; 8 days for 150 epochs (from past discussions), i'm sharing my current training log as follow</p>\n</blockquote>\n<hr>\n<table>\n<thead>\n<tr>\n<th>Epoch</th>\n<th>Train</th>\n<th>CV</th>\n</tr>\n</thead>\n<tbody>\n<tr>\n<td>14</td>\n<td>37.9</td>\n<td>33.3</td>\n</tr>\n<tr>\n<td>17</td>\n<td>36.0</td>\n<td>32.7</td>\n</tr>\n<tr>\n<td>18</td>\n<td>35.4</td>\n<td>31.5</td>\n</tr>\n<tr>\n<td>19</td>\n<td>34.9</td>\n<td>34.0</td>\n</tr>\n<tr>\n<td>20</td>\n<td>34.5</td>\n<td>31.5</td>\n</tr>\n<tr>\n<td>Testing different models for 20 epochs</td>\n<td></td>\n<td></td>\n</tr>\n</tbody>\n</table>",
      "rawMarkdown": "> As, training taking too long -> 8 days for 150 epochs (from past discussions), i'm sharing my current training log as follow\n\n--- \n\n| Epoch | Train | CV |\n| --- | --- | --- |\n| 14 | 37.9 | 33.3 |\n| 17 | 36.0 | 32.7 |\n| 18 | 35.4 | 31.5 |\n| 19 | 34.9 | 34.0 |\n| 20 | 34.5 | 31.5 |\n| Testing different models for 20 epochs |\n",
      "votes": 6
    },
    {
      "id": 3220939,
      "postDate": "2025-06-10T07:14:29.380Z",
      "content": "<p>what's you training config,  like learning rate, batch size, scheduler</p>",
      "rawMarkdown": "what's you training config,  like learning rate, batch size, scheduler",
      "votes": 1,
      "replies": [
        {
          "id": 3220985,
          "postDate": "2025-06-10T08:31:13.020Z",
          "content": "<p>Almost same as Bartley's training flow <a href=\"https://www.kaggle.com/lihaoweicvch\" target=\"_blank\">@lihaoweicvch</a> </p>",
          "rawMarkdown": "Almost same as Bartley's training flow @lihaoweicvch ",
          "replies": [
            {
              "id": 3220994,
              "postDate": "2025-06-10T08:46:49.827Z",
              "content": "<p>would you share epoch 1~5's   result (train and CV) if available ?</p>",
              "rawMarkdown": "would you share epoch 1~5's   result (train and CV) if available ?",
              "votes": 1
            },
            {
              "id": 3220999,
              "postDate": "2025-06-10T08:59:36.713Z",
              "content": "<p>i have only last epoch scores, tomorrow will do next experiment if it perform better will share <a href=\"https://www.kaggle.com/lihaoweicvch\" target=\"_blank\">@lihaoweicvch</a> </p>",
              "rawMarkdown": "i have only last epoch scores, tomorrow will do next experiment if it perform better will share @lihaoweicvch "
            },
            {
              "id": 3221523,
              "postDate": "2025-06-11T06:00:40.190Z",
              "content": "<table>\n<thead>\n<tr>\n<th>Epoch</th>\n<th>Train</th>\n<th>CV</th>\n</tr>\n</thead>\n<tbody>\n<tr>\n<td>2</td>\n<td>68.0</td>\n<td>55.9</td>\n</tr>\n<tr>\n<td>3</td>\n<td>58.4</td>\n<td>51.3</td>\n</tr>\n<tr>\n<td>4</td>\n<td>53.0</td>\n<td>45.8</td>\n</tr>\n<tr>\n<td>5</td>\n<td>49.3</td>\n<td>42.5</td>\n</tr>\n<tr>\n<td>training continue …</td>\n<td></td>\n<td></td>\n</tr>\n</tbody>\n</table>\n<hr>\n<p><a href=\"https://www.kaggle.com/lihaoweicvch\" target=\"_blank\">@lihaoweicvch</a> -- same model on <strong><a href=\"https://www.kaggle.com/competitions/waveform-inversion/discussion/580892#3221434\" target=\"_blank\">CurveFault_B</a></strong> trained for 60 epochs</p>",
              "rawMarkdown": "| Epoch | Train | CV |\n| --- | --- | --- |\n| 2 | 68.0 | 55.9 |\n| 3 | 58.4 | 51.3 |\n| 4 | 53.0 | 45.8 |\n| 5 | 49.3 | 42.5 |\n| training continue ... |\n\n---\n\n@lihaoweicvch -- same model on **[CurveFault_B](https://www.kaggle.com/competitions/waveform-inversion/discussion/580892#3221434)** trained for 60 epochs\n",
              "votes": 1
            },
            {
              "id": 3222001,
              "postDate": "2025-06-11T17:40:58.433Z",
              "rawMarkdown": "",
              "isDeleted": true
            }
          ]
        }
      ]
    },
    {
      "id": 3223309,
      "postDate": "2025-06-13T06:29:31.180Z",
      "content": "<p>My first 28 epochs training logs --&gt; <a href=\"https://www.kaggle.com/oliver34\" target=\"_blank\">@oliver34</a> is it correlate with your training cv?</p>\n<blockquote>\n  <table>\n  <thead>\n  <tr>\n  <th>Epoch</th>\n  <th>TRAIN</th>\n  <th>CV</th>\n  <th>CFA</th>\n  <th>CFB</th>\n  <th>CVA</th>\n  <th>CVB</th>\n  <th>FFA</th>\n  <th>FFB</th>\n  <th>FVA</th>\n  <th>FVB</th>\n  <th>SA</th>\n  <th>SB</th>\n  </tr>\n  </thead>\n  <tbody>\n  <tr>\n  <td>Exp40-00</td>\n  <td>94</td>\n  <td>65</td>\n  <td>31</td>\n  <td>121</td>\n  <td>55</td>\n  <td>141</td>\n  <td>23</td>\n  <td>85</td>\n  <td>20</td>\n  <td>56</td>\n  <td>63</td>\n  <td>55</td>\n  </tr>\n  <tr>\n  <td>Exp40-01</td>\n  <td>66</td>\n  <td>54</td>\n  <td>24</td>\n  <td>109</td>\n  <td>44</td>\n  <td>109</td>\n  <td>18</td>\n  <td>72</td>\n  <td>15</td>\n  <td>42</td>\n  <td>54</td>\n  <td>50</td>\n  </tr>\n  <tr>\n  <td>Exp40-02</td>\n  <td>57</td>\n  <td>48</td>\n  <td>20</td>\n  <td>103</td>\n  <td>38</td>\n  <td>94</td>\n  <td>16</td>\n  <td>65</td>\n  <td>12</td>\n  <td>36</td>\n  <td>49</td>\n  <td>48</td>\n  </tr>\n  <tr>\n  <td>Exp40-03</td>\n  <td>52</td>\n  <td>45</td>\n  <td>19</td>\n  <td>98</td>\n  <td>35</td>\n  <td>85</td>\n  <td>15</td>\n  <td>61</td>\n  <td>11</td>\n  <td>33</td>\n  <td>47</td>\n  <td>46</td>\n  </tr>\n  <tr>\n  <td>Exp40-04</td>\n  <td>49</td>\n  <td>42</td>\n  <td>17</td>\n  <td>94</td>\n  <td>32</td>\n  <td>79</td>\n  <td>14</td>\n  <td>57</td>\n  <td>10</td>\n  <td>29</td>\n  <td>45</td>\n  <td>45</td>\n  </tr>\n  <tr>\n  <td>Exp40-05</td>\n  <td>46</td>\n  <td>41</td>\n  <td>17</td>\n  <td>92</td>\n  <td>30</td>\n  <td>73</td>\n  <td>14</td>\n  <td>55</td>\n  <td>10</td>\n  <td>27</td>\n  <td>43</td>\n  <td>44</td>\n  </tr>\n  <tr>\n  <td>Exp40-06</td>\n  <td>44</td>\n  <td>39</td>\n  <td>16</td>\n  <td>89</td>\n  <td>28</td>\n  <td>70</td>\n  <td>12</td>\n  <td>52</td>\n  <td>8</td>\n  <td>25</td>\n  <td>41</td>\n  <td>43</td>\n  </tr>\n  <tr>\n  <td>Exp40-07</td>\n  <td>42</td>\n  <td>38</td>\n  <td>15</td>\n  <td>87</td>\n  <td>27</td>\n  <td>68</td>\n  <td>11</td>\n  <td>50</td>\n  <td>8</td>\n  <td>23</td>\n  <td>40</td>\n  <td>42</td>\n  </tr>\n  <tr>\n  <td>Exp40-08</td>\n  <td>41</td>\n  <td>36</td>\n  <td>14</td>\n  <td>86</td>\n  <td>26</td>\n  <td>65</td>\n  <td>11</td>\n  <td>49</td>\n  <td>7</td>\n  <td>22</td>\n  <td>39</td>\n  <td>42</td>\n  </tr>\n  <tr>\n  <td>Exp40-09</td>\n  <td>39</td>\n  <td>36</td>\n  <td>14</td>\n  <td>84</td>\n  <td>25</td>\n  <td>64</td>\n  <td>10</td>\n  <td>48</td>\n  <td>7</td>\n  <td>22</td>\n  <td>39</td>\n  <td>41</td>\n  </tr>\n  <tr>\n  <td>Exp40-10</td>\n  <td>38</td>\n  <td>35</td>\n  <td>13</td>\n  <td>83</td>\n  <td>24</td>\n  <td>62</td>\n  <td>10</td>\n  <td>46</td>\n  <td>7</td>\n  <td>21</td>\n  <td>38</td>\n  <td>41</td>\n  </tr>\n  <tr>\n  <td>Exp40-11</td>\n  <td>37</td>\n  <td>34</td>\n  <td>13</td>\n  <td>82</td>\n  <td>23</td>\n  <td>60</td>\n  <td>10</td>\n  <td>45</td>\n  <td>6</td>\n  <td>20</td>\n  <td>38</td>\n  <td>41</td>\n  </tr>\n  <tr>\n  <td>Exp40-12</td>\n  <td>37</td>\n  <td>34</td>\n  <td>13</td>\n  <td>81</td>\n  <td>23</td>\n  <td>59</td>\n  <td>10</td>\n  <td>45</td>\n  <td>7</td>\n  <td>20</td>\n  <td>37</td>\n  <td>40</td>\n  </tr>\n  <tr>\n  <td>Exp40-13</td>\n  <td>36</td>\n  <td>33</td>\n  <td>12</td>\n  <td>80</td>\n  <td>22</td>\n  <td>58</td>\n  <td>9</td>\n  <td>44</td>\n  <td>6</td>\n  <td>18</td>\n  <td>37</td>\n  <td>40</td>\n  </tr>\n  <tr>\n  <td>Exp40-14</td>\n  <td>35</td>\n  <td>33</td>\n  <td>12</td>\n  <td>79</td>\n  <td>22</td>\n  <td>57</td>\n  <td>9</td>\n  <td>43</td>\n  <td>6</td>\n  <td>18</td>\n  <td>36</td>\n  <td>40</td>\n  </tr>\n  <tr>\n  <td>Exp40-15</td>\n  <td>34</td>\n  <td>32</td>\n  <td>12</td>\n  <td>79</td>\n  <td>22</td>\n  <td>56</td>\n  <td>9</td>\n  <td>43</td>\n  <td>6</td>\n  <td>18</td>\n  <td>36</td>\n  <td>40</td>\n  </tr>\n  <tr>\n  <td>Exp40-16</td>\n  <td>34</td>\n  <td>32</td>\n  <td>12</td>\n  <td>78</td>\n  <td>22</td>\n  <td>55</td>\n  <td>9</td>\n  <td>42</td>\n  <td>7</td>\n  <td>17</td>\n  <td>35</td>\n  <td>40</td>\n  </tr>\n  <tr>\n  <td>Exp40-17</td>\n  <td>33</td>\n  <td>32</td>\n  <td>12</td>\n  <td>77</td>\n  <td>21</td>\n  <td>54</td>\n  <td>9</td>\n  <td>42</td>\n  <td>6</td>\n  <td>18</td>\n  <td>35</td>\n  <td>39</td>\n  </tr>\n  <tr>\n  <td>Exp40-18</td>\n  <td>33</td>\n  <td>31</td>\n  <td>11</td>\n  <td>77</td>\n  <td>20</td>\n  <td>54</td>\n  <td>8</td>\n  <td>41</td>\n  <td>6</td>\n  <td>17</td>\n  <td>35</td>\n  <td>39</td>\n  </tr>\n  <tr>\n  <td>Exp40-19</td>\n  <td>32</td>\n  <td>31</td>\n  <td>11</td>\n  <td>76</td>\n  <td>20</td>\n  <td>53</td>\n  <td>8</td>\n  <td>40</td>\n  <td>5</td>\n  <td>16</td>\n  <td>34</td>\n  <td>39</td>\n  </tr>\n  <tr>\n  <td>Exp40-20</td>\n  <td>32</td>\n  <td>31</td>\n  <td>11</td>\n  <td>76</td>\n  <td>20</td>\n  <td>53</td>\n  <td>9</td>\n  <td>40</td>\n  <td>6</td>\n  <td>17</td>\n  <td>35</td>\n  <td>39</td>\n  </tr>\n  <tr>\n  <td>Exp40-21</td>\n  <td>32</td>\n  <td>31</td>\n  <td>11</td>\n  <td>76</td>\n  <td>20</td>\n  <td>52</td>\n  <td>9</td>\n  <td>40</td>\n  <td>6</td>\n  <td>16</td>\n  <td>34</td>\n  <td>39</td>\n  </tr>\n  <tr>\n  <td>Exp40-22</td>\n  <td>31</td>\n  <td>30</td>\n  <td>11</td>\n  <td>75</td>\n  <td>20</td>\n  <td>52</td>\n  <td>9</td>\n  <td>40</td>\n  <td>6</td>\n  <td>16</td>\n  <td>34</td>\n  <td>39</td>\n  </tr>\n  <tr>\n  <td>Exp40-23</td>\n  <td>31</td>\n  <td>30</td>\n  <td>10</td>\n  <td>75</td>\n  <td>19</td>\n  <td>51</td>\n  <td>8</td>\n  <td>39</td>\n  <td>5</td>\n  <td>16</td>\n  <td>34</td>\n  <td>38</td>\n  </tr>\n  <tr>\n  <td>Exp40-24</td>\n  <td>31</td>\n  <td>30</td>\n  <td>11</td>\n  <td>75</td>\n  <td>19</td>\n  <td>51</td>\n  <td>9</td>\n  <td>39</td>\n  <td>6</td>\n  <td>16</td>\n  <td>34</td>\n  <td>38</td>\n  </tr>\n  <tr>\n  <td>Exp40-25</td>\n  <td>30</td>\n  <td>30</td>\n  <td>10</td>\n  <td>74</td>\n  <td>19</td>\n  <td>51</td>\n  <td>8</td>\n  <td>38</td>\n  <td>5</td>\n  <td>15</td>\n  <td>33</td>\n  <td>38</td>\n  </tr>\n  <tr>\n  <td>Exp40-26</td>\n  <td>30</td>\n  <td>29</td>\n  <td>10</td>\n  <td>74</td>\n  <td>18</td>\n  <td>50</td>\n  <td>7</td>\n  <td>38</td>\n  <td>4</td>\n  <td>15</td>\n  <td>33</td>\n  <td>38</td>\n  </tr>\n  <tr>\n  <td>Exp40-27</td>\n  <td>30</td>\n  <td>29</td>\n  <td>10</td>\n  <td>74</td>\n  <td>18</td>\n  <td>50</td>\n  <td>8</td>\n  <td>38</td>\n  <td>5</td>\n  <td>15</td>\n  <td>33</td>\n  <td>38</td>\n  </tr>\n  <tr>\n  <td>Exp40-28</td>\n  <td>29</td>\n  <td>29</td>\n  <td>10</td>\n  <td>73</td>\n  <td>18</td>\n  <td>50</td>\n  <td>7</td>\n  <td>38</td>\n  <td>5</td>\n  <td>15</td>\n  <td>33</td>\n  <td>38</td>\n  </tr>\n  </tbody>\n  </table>\n</blockquote>",
      "rawMarkdown": "My first 28 epochs training logs --> @oliver34 is it correlate with your training cv?\n\n> | Epoch    |   TRAIN |   CV |   CFA |   CFB |   CVA |   CVB |   FFA |   FFB |   FVA |   FVB |   SA |   SB |\n|:---------|--------:|-----:|------:|------:|------:|------:|------:|------:|------:|------:|-----:|-----:|\n| Exp40-00 |      94 |   65 |    31 |   121 |    55 |   141 |    23 |    85 |    20 |    56 |   63 |   55 |\n| Exp40-01 |      66 |   54 |    24 |   109 |    44 |   109 |    18 |    72 |    15 |    42 |   54 |   50 |\n| Exp40-02 |      57 |   48 |    20 |   103 |    38 |    94 |    16 |    65 |    12 |    36 |   49 |   48 |\n| Exp40-03 |      52 |   45 |    19 |    98 |    35 |    85 |    15 |    61 |    11 |    33 |   47 |   46 |\n| Exp40-04 |      49 |   42 |    17 |    94 |    32 |    79 |    14 |    57 |    10 |    29 |   45 |   45 |\n| Exp40-05 |      46 |   41 |    17 |    92 |    30 |    73 |    14 |    55 |    10 |    27 |   43 |   44 |\n| Exp40-06 |      44 |   39 |    16 |    89 |    28 |    70 |    12 |    52 |     8 |    25 |   41 |   43 |\n| Exp40-07 |      42 |   38 |    15 |    87 |    27 |    68 |    11 |    50 |     8 |    23 |   40 |   42 |\n| Exp40-08 |      41 |   36 |    14 |    86 |    26 |    65 |    11 |    49 |     7 |    22 |   39 |   42 |\n| Exp40-09 |      39 |   36 |    14 |    84 |    25 |    64 |    10 |    48 |     7 |    22 |   39 |   41 |\n| Exp40-10 |      38 |   35 |    13 |    83 |    24 |    62 |    10 |    46 |     7 |    21 |   38 |   41 |\n| Exp40-11 |      37 |   34 |    13 |    82 |    23 |    60 |    10 |    45 |     6 |    20 |   38 |   41 |\n| Exp40-12 |      37 |   34 |    13 |    81 |    23 |    59 |    10 |    45 |     7 |    20 |   37 |   40 |\n| Exp40-13 |      36 |   33 |    12 |    80 |    22 |    58 |     9 |    44 |     6 |    18 |   37 |   40 |\n| Exp40-14 |      35 |   33 |    12 |    79 |    22 |    57 |     9 |    43 |     6 |    18 |   36 |   40 |\n| Exp40-15 |      34 |   32 |    12 |    79 |    22 |    56 |     9 |    43 |     6 |    18 |   36 |   40 |\n| Exp40-16 |      34 |   32 |    12 |    78 |    22 |    55 |     9 |    42 |     7 |    17 |   35 |   40 |\n| Exp40-17 |      33 |   32 |    12 |    77 |    21 |    54 |     9 |    42 |     6 |    18 |   35 |   39 |\n| Exp40-18 |      33 |   31 |    11 |    77 |    20 |    54 |     8 |    41 |     6 |    17 |   35 |   39 |\n| Exp40-19 |      32 |   31 |    11 |    76 |    20 |    53 |     8 |    40 |     5 |    16 |   34 |   39 |\n| Exp40-20 |      32 |   31 |    11 |    76 |    20 |    53 |     9 |    40 |     6 |    17 |   35 |   39 |\n| Exp40-21 |      32 |   31 |    11 |    76 |    20 |    52 |     9 |    40 |     6 |    16 |   34 |   39 |\n| Exp40-22 |      31 |   30 |    11 |    75 |    20 |    52 |     9 |    40 |     6 |    16 |   34 |   39 |\n| Exp40-23 |      31 |   30 |    10 |    75 |    19 |    51 |     8 |    39 |     5 |    16 |   34 |   38 |\n| Exp40-24 |      31 |   30 |    11 |    75 |    19 |    51 |     9 |    39 |     6 |    16 |   34 |   38 |\n| Exp40-25 |      30 |   30 |    10 |    74 |    19 |    51 |     8 |    38 |     5 |    15 |   33 |   38 |\n| Exp40-26 |      30 |   29 |    10 |    74 |    18 |    50 |     7 |    38 |     4 |    15 |   33 |   38 |\n| Exp40-27 |      30 |   29 |    10 |    74 |    18 |    50 |     8 |    38 |     5 |    15 |   33 |   38 |\n| Exp40-28 |      29 |   29 |    10 |    73 |    18 |    50 |     7 |    38 |     5 |    15 |   33 |   38 |",
      "replies": [
        {
          "id": 3224327,
          "postDate": "2025-06-14T17:06:58.097Z",
          "content": "<p>what is the training params? like optimizer, lr, …</p>",
          "rawMarkdown": "what is the training params? like optimizer, lr, ...",
          "votes": 1,
          "replies": [
            {
              "id": 3224406,
              "postDate": "2025-06-14T20:06:39.240Z",
              "content": "<p>Adamw with fuse - same as shared in training speed discussion, almost same as public notebook training parameters. <a href=\"https://www.kaggle.com/jamalsaeedi\" target=\"_blank\">@jamalsaeedi</a> </p>",
              "rawMarkdown": "Adamw with fuse - same as shared in training speed discussion, almost same as public notebook training parameters. @jamalsaeedi ",
              "votes": 1
            }
          ]
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 3220939,
      "author_name": "lhwcv",
      "author_url": "",
      "post_date": "2025-06-10T07:14:29.380000",
      "content": "<p>what's you training config,  like learning rate, batch size, scheduler</p>",
      "votes": 1,
      "replies": [
        {
          "id": 3220985,
          "author_name": "SeshuRaju 🧘‍♂️",
          "author_url": "",
          "post_date": "2025-06-10T08:31:13.020000",
          "content": "<p>Almost same as Bartley's training flow <a href=\"https://www.kaggle.com/lihaoweicvch\" target=\"_blank\">@lihaoweicvch</a> </p>",
          "votes": 0,
          "replies": [
            {
              "id": 3220994,
              "author_name": "lhwcv",
              "author_url": "",
              "post_date": "2025-06-10T08:46:49.827000",
              "content": "<p>would you share epoch 1~5's   result (train and CV) if available ?</p>",
              "votes": 1,
              "replies": []
            },
            {
              "id": 3220999,
              "author_name": "SeshuRaju 🧘‍♂️",
              "author_url": "",
              "post_date": "2025-06-10T08:59:36.713000",
              "content": "<p>i have only last epoch scores, tomorrow will do next experiment if it perform better will share <a href=\"https://www.kaggle.com/lihaoweicvch\" target=\"_blank\">@lihaoweicvch</a> </p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 3221523,
              "author_name": "SeshuRaju 🧘‍♂️",
              "author_url": "",
              "post_date": "2025-06-11T06:00:40.190000",
              "content": "<table>\n<thead>\n<tr>\n<th>Epoch</th>\n<th>Train</th>\n<th>CV</th>\n</tr>\n</thead>\n<tbody>\n<tr>\n<td>2</td>\n<td>68.0</td>\n<td>55.9</td>\n</tr>\n<tr>\n<td>3</td>\n<td>58.4</td>\n<td>51.3</td>\n</tr>\n<tr>\n<td>4</td>\n<td>53.0</td>\n<td>45.8</td>\n</tr>\n<tr>\n<td>5</td>\n<td>49.3</td>\n<td>42.5</td>\n</tr>\n<tr>\n<td>training continue …</td>\n<td></td>\n<td></td>\n</tr>\n</tbody>\n</table>\n<hr>\n<p><a href=\"https://www.kaggle.com/lihaoweicvch\" target=\"_blank\">@lihaoweicvch</a> -- same model on <strong><a href=\"https://www.kaggle.com/competitions/waveform-inversion/discussion/580892#3221434\" target=\"_blank\">CurveFault_B</a></strong> trained for 60 epochs</p>",
              "votes": 1,
              "replies": []
            },
            {
              "id": 3222001,
              "author_name": "",
              "author_url": "",
              "post_date": "2025-06-11T17:40:58.433000",
              "content": "",
              "votes": 0,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 3223309,
      "author_name": "SeshuRaju 🧘‍♂️",
      "author_url": "",
      "post_date": "2025-06-13T06:29:31.180000",
      "content": "<p>My first 28 epochs training logs --&gt; <a href=\"https://www.kaggle.com/oliver34\" target=\"_blank\">@oliver34</a> is it correlate with your training cv?</p>\n<blockquote>\n  <table>\n  <thead>\n  <tr>\n  <th>Epoch</th>\n  <th>TRAIN</th>\n  <th>CV</th>\n  <th>CFA</th>\n  <th>CFB</th>\n  <th>CVA</th>\n  <th>CVB</th>\n  <th>FFA</th>\n  <th>FFB</th>\n  <th>FVA</th>\n  <th>FVB</th>\n  <th>SA</th>\n  <th>SB</th>\n  </tr>\n  </thead>\n  <tbody>\n  <tr>\n  <td>Exp40-00</td>\n  <td>94</td>\n  <td>65</td>\n  <td>31</td>\n  <td>121</td>\n  <td>55</td>\n  <td>141</td>\n  <td>23</td>\n  <td>85</td>\n  <td>20</td>\n  <td>56</td>\n  <td>63</td>\n  <td>55</td>\n  </tr>\n  <tr>\n  <td>Exp40-01</td>\n  <td>66</td>\n  <td>54</td>\n  <td>24</td>\n  <td>109</td>\n  <td>44</td>\n  <td>109</td>\n  <td>18</td>\n  <td>72</td>\n  <td>15</td>\n  <td>42</td>\n  <td>54</td>\n  <td>50</td>\n  </tr>\n  <tr>\n  <td>Exp40-02</td>\n  <td>57</td>\n  <td>48</td>\n  <td>20</td>\n  <td>103</td>\n  <td>38</td>\n  <td>94</td>\n  <td>16</td>\n  <td>65</td>\n  <td>12</td>\n  <td>36</td>\n  <td>49</td>\n  <td>48</td>\n  </tr>\n  <tr>\n  <td>Exp40-03</td>\n  <td>52</td>\n  <td>45</td>\n  <td>19</td>\n  <td>98</td>\n  <td>35</td>\n  <td>85</td>\n  <td>15</td>\n  <td>61</td>\n  <td>11</td>\n  <td>33</td>\n  <td>47</td>\n  <td>46</td>\n  </tr>\n  <tr>\n  <td>Exp40-04</td>\n  <td>49</td>\n  <td>42</td>\n  <td>17</td>\n  <td>94</td>\n  <td>32</td>\n  <td>79</td>\n  <td>14</td>\n  <td>57</td>\n  <td>10</td>\n  <td>29</td>\n  <td>45</td>\n  <td>45</td>\n  </tr>\n  <tr>\n  <td>Exp40-05</td>\n  <td>46</td>\n  <td>41</td>\n  <td>17</td>\n  <td>92</td>\n  <td>30</td>\n  <td>73</td>\n  <td>14</td>\n  <td>55</td>\n  <td>10</td>\n  <td>27</td>\n  <td>43</td>\n  <td>44</td>\n  </tr>\n  <tr>\n  <td>Exp40-06</td>\n  <td>44</td>\n  <td>39</td>\n  <td>16</td>\n  <td>89</td>\n  <td>28</td>\n  <td>70</td>\n  <td>12</td>\n  <td>52</td>\n  <td>8</td>\n  <td>25</td>\n  <td>41</td>\n  <td>43</td>\n  </tr>\n  <tr>\n  <td>Exp40-07</td>\n  <td>42</td>\n  <td>38</td>\n  <td>15</td>\n  <td>87</td>\n  <td>27</td>\n  <td>68</td>\n  <td>11</td>\n  <td>50</td>\n  <td>8</td>\n  <td>23</td>\n  <td>40</td>\n  <td>42</td>\n  </tr>\n  <tr>\n  <td>Exp40-08</td>\n  <td>41</td>\n  <td>36</td>\n  <td>14</td>\n  <td>86</td>\n  <td>26</td>\n  <td>65</td>\n  <td>11</td>\n  <td>49</td>\n  <td>7</td>\n  <td>22</td>\n  <td>39</td>\n  <td>42</td>\n  </tr>\n  <tr>\n  <td>Exp40-09</td>\n  <td>39</td>\n  <td>36</td>\n  <td>14</td>\n  <td>84</td>\n  <td>25</td>\n  <td>64</td>\n  <td>10</td>\n  <td>48</td>\n  <td>7</td>\n  <td>22</td>\n  <td>39</td>\n  <td>41</td>\n  </tr>\n  <tr>\n  <td>Exp40-10</td>\n  <td>38</td>\n  <td>35</td>\n  <td>13</td>\n  <td>83</td>\n  <td>24</td>\n  <td>62</td>\n  <td>10</td>\n  <td>46</td>\n  <td>7</td>\n  <td>21</td>\n  <td>38</td>\n  <td>41</td>\n  </tr>\n  <tr>\n  <td>Exp40-11</td>\n  <td>37</td>\n  <td>34</td>\n  <td>13</td>\n  <td>82</td>\n  <td>23</td>\n  <td>60</td>\n  <td>10</td>\n  <td>45</td>\n  <td>6</td>\n  <td>20</td>\n  <td>38</td>\n  <td>41</td>\n  </tr>\n  <tr>\n  <td>Exp40-12</td>\n  <td>37</td>\n  <td>34</td>\n  <td>13</td>\n  <td>81</td>\n  <td>23</td>\n  <td>59</td>\n  <td>10</td>\n  <td>45</td>\n  <td>7</td>\n  <td>20</td>\n  <td>37</td>\n  <td>40</td>\n  </tr>\n  <tr>\n  <td>Exp40-13</td>\n  <td>36</td>\n  <td>33</td>\n  <td>12</td>\n  <td>80</td>\n  <td>22</td>\n  <td>58</td>\n  <td>9</td>\n  <td>44</td>\n  <td>6</td>\n  <td>18</td>\n  <td>37</td>\n  <td>40</td>\n  </tr>\n  <tr>\n  <td>Exp40-14</td>\n  <td>35</td>\n  <td>33</td>\n  <td>12</td>\n  <td>79</td>\n  <td>22</td>\n  <td>57</td>\n  <td>9</td>\n  <td>43</td>\n  <td>6</td>\n  <td>18</td>\n  <td>36</td>\n  <td>40</td>\n  </tr>\n  <tr>\n  <td>Exp40-15</td>\n  <td>34</td>\n  <td>32</td>\n  <td>12</td>\n  <td>79</td>\n  <td>22</td>\n  <td>56</td>\n  <td>9</td>\n  <td>43</td>\n  <td>6</td>\n  <td>18</td>\n  <td>36</td>\n  <td>40</td>\n  </tr>\n  <tr>\n  <td>Exp40-16</td>\n  <td>34</td>\n  <td>32</td>\n  <td>12</td>\n  <td>78</td>\n  <td>22</td>\n  <td>55</td>\n  <td>9</td>\n  <td>42</td>\n  <td>7</td>\n  <td>17</td>\n  <td>35</td>\n  <td>40</td>\n  </tr>\n  <tr>\n  <td>Exp40-17</td>\n  <td>33</td>\n  <td>32</td>\n  <td>12</td>\n  <td>77</td>\n  <td>21</td>\n  <td>54</td>\n  <td>9</td>\n  <td>42</td>\n  <td>6</td>\n  <td>18</td>\n  <td>35</td>\n  <td>39</td>\n  </tr>\n  <tr>\n  <td>Exp40-18</td>\n  <td>33</td>\n  <td>31</td>\n  <td>11</td>\n  <td>77</td>\n  <td>20</td>\n  <td>54</td>\n  <td>8</td>\n  <td>41</td>\n  <td>6</td>\n  <td>17</td>\n  <td>35</td>\n  <td>39</td>\n  </tr>\n  <tr>\n  <td>Exp40-19</td>\n  <td>32</td>\n  <td>31</td>\n  <td>11</td>\n  <td>76</td>\n  <td>20</td>\n  <td>53</td>\n  <td>8</td>\n  <td>40</td>\n  <td>5</td>\n  <td>16</td>\n  <td>34</td>\n  <td>39</td>\n  </tr>\n  <tr>\n  <td>Exp40-20</td>\n  <td>32</td>\n  <td>31</td>\n  <td>11</td>\n  <td>76</td>\n  <td>20</td>\n  <td>53</td>\n  <td>9</td>\n  <td>40</td>\n  <td>6</td>\n  <td>17</td>\n  <td>35</td>\n  <td>39</td>\n  </tr>\n  <tr>\n  <td>Exp40-21</td>\n  <td>32</td>\n  <td>31</td>\n  <td>11</td>\n  <td>76</td>\n  <td>20</td>\n  <td>52</td>\n  <td>9</td>\n  <td>40</td>\n  <td>6</td>\n  <td>16</td>\n  <td>34</td>\n  <td>39</td>\n  </tr>\n  <tr>\n  <td>Exp40-22</td>\n  <td>31</td>\n  <td>30</td>\n  <td>11</td>\n  <td>75</td>\n  <td>20</td>\n  <td>52</td>\n  <td>9</td>\n  <td>40</td>\n  <td>6</td>\n  <td>16</td>\n  <td>34</td>\n  <td>39</td>\n  </tr>\n  <tr>\n  <td>Exp40-23</td>\n  <td>31</td>\n  <td>30</td>\n  <td>10</td>\n  <td>75</td>\n  <td>19</td>\n  <td>51</td>\n  <td>8</td>\n  <td>39</td>\n  <td>5</td>\n  <td>16</td>\n  <td>34</td>\n  <td>38</td>\n  </tr>\n  <tr>\n  <td>Exp40-24</td>\n  <td>31</td>\n  <td>30</td>\n  <td>11</td>\n  <td>75</td>\n  <td>19</td>\n  <td>51</td>\n  <td>9</td>\n  <td>39</td>\n  <td>6</td>\n  <td>16</td>\n  <td>34</td>\n  <td>38</td>\n  </tr>\n  <tr>\n  <td>Exp40-25</td>\n  <td>30</td>\n  <td>30</td>\n  <td>10</td>\n  <td>74</td>\n  <td>19</td>\n  <td>51</td>\n  <td>8</td>\n  <td>38</td>\n  <td>5</td>\n  <td>15</td>\n  <td>33</td>\n  <td>38</td>\n  </tr>\n  <tr>\n  <td>Exp40-26</td>\n  <td>30</td>\n  <td>29</td>\n  <td>10</td>\n  <td>74</td>\n  <td>18</td>\n  <td>50</td>\n  <td>7</td>\n  <td>38</td>\n  <td>4</td>\n  <td>15</td>\n  <td>33</td>\n  <td>38</td>\n  </tr>\n  <tr>\n  <td>Exp40-27</td>\n  <td>30</td>\n  <td>29</td>\n  <td>10</td>\n  <td>74</td>\n  <td>18</td>\n  <td>50</td>\n  <td>8</td>\n  <td>38</td>\n  <td>5</td>\n  <td>15</td>\n  <td>33</td>\n  <td>38</td>\n  </tr>\n  <tr>\n  <td>Exp40-28</td>\n  <td>29</td>\n  <td>29</td>\n  <td>10</td>\n  <td>73</td>\n  <td>18</td>\n  <td>50</td>\n  <td>7</td>\n  <td>38</td>\n  <td>5</td>\n  <td>15</td>\n  <td>33</td>\n  <td>38</td>\n  </tr>\n  </tbody>\n  </table>\n</blockquote>",
      "votes": 0,
      "replies": [
        {
          "id": 3224327,
          "author_name": "Cyrus",
          "author_url": "",
          "post_date": "2025-06-14T17:06:58.097000",
          "content": "<p>what is the training params? like optimizer, lr, …</p>",
          "votes": 1,
          "replies": [
            {
              "id": 3224406,
              "author_name": "SeshuRaju 🧘‍♂️",
              "author_url": "",
              "post_date": "2025-06-14T20:06:39.240000",
              "content": "<p>Adamw with fuse - same as shared in training speed discussion, almost same as public notebook training parameters. <a href=\"https://www.kaggle.com/jamalsaeedi\" target=\"_blank\">@jamalsaeedi</a> </p>",
              "votes": 1,
              "replies": []
            }
          ]
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "3220894": "> As, training taking too long -> 8 days for 150 epochs (from past discussions), i'm sharing my current training log as follow\n\n--- \n\n| Epoch | Train | CV |\n| --- | --- | --- |\n| 14 | 37.9 | 33.3 |\n| 17 | 36.0 | 32.7 |\n| 18 | 35.4 | 31.5 |\n| 19 | 34.9 | 34.0 |\n| 20 | 34.5 | 31.5 |\n| Testing different models for 20 epochs |\n",
    "3220939": "what's you training config,  like learning rate, batch size, scheduler",
    "3223309": "My first 28 epochs training logs --> @oliver34 is it correlate with your training cv?\n\n> | Epoch    |   TRAIN |   CV |   CFA |   CFB |   CVA |   CVB |   FFA |   FFB |   FVA |   FVB |   SA |   SB |\n|:---------|--------:|-----:|------:|------:|------:|------:|------:|------:|------:|------:|-----:|-----:|\n| Exp40-00 |      94 |   65 |    31 |   121 |    55 |   141 |    23 |    85 |    20 |    56 |   63 |   55 |\n| Exp40-01 |      66 |   54 |    24 |   109 |    44 |   109 |    18 |    72 |    15 |    42 |   54 |   50 |\n| Exp40-02 |      57 |   48 |    20 |   103 |    38 |    94 |    16 |    65 |    12 |    36 |   49 |   48 |\n| Exp40-03 |      52 |   45 |    19 |    98 |    35 |    85 |    15 |    61 |    11 |    33 |   47 |   46 |\n| Exp40-04 |      49 |   42 |    17 |    94 |    32 |    79 |    14 |    57 |    10 |    29 |   45 |   45 |\n| Exp40-05 |      46 |   41 |    17 |    92 |    30 |    73 |    14 |    55 |    10 |    27 |   43 |   44 |\n| Exp40-06 |      44 |   39 |    16 |    89 |    28 |    70 |    12 |    52 |     8 |    25 |   41 |   43 |\n| Exp40-07 |      42 |   38 |    15 |    87 |    27 |    68 |    11 |    50 |     8 |    23 |   40 |   42 |\n| Exp40-08 |      41 |   36 |    14 |    86 |    26 |    65 |    11 |    49 |     7 |    22 |   39 |   42 |\n| Exp40-09 |      39 |   36 |    14 |    84 |    25 |    64 |    10 |    48 |     7 |    22 |   39 |   41 |\n| Exp40-10 |      38 |   35 |    13 |    83 |    24 |    62 |    10 |    46 |     7 |    21 |   38 |   41 |\n| Exp40-11 |      37 |   34 |    13 |    82 |    23 |    60 |    10 |    45 |     6 |    20 |   38 |   41 |\n| Exp40-12 |      37 |   34 |    13 |    81 |    23 |    59 |    10 |    45 |     7 |    20 |   37 |   40 |\n| Exp40-13 |      36 |   33 |    12 |    80 |    22 |    58 |     9 |    44 |     6 |    18 |   37 |   40 |\n| Exp40-14 |      35 |   33 |    12 |    79 |    22 |    57 |     9 |    43 |     6 |    18 |   36 |   40 |\n| Exp40-15 |      34 |   32 |    12 |    79 |    22 |    56 |     9 |    43 |     6 |    18 |   36 |   40 |\n| Exp40-16 |      34 |   32 |    12 |    78 |    22 |    55 |     9 |    42 |     7 |    17 |   35 |   40 |\n| Exp40-17 |      33 |   32 |    12 |    77 |    21 |    54 |     9 |    42 |     6 |    18 |   35 |   39 |\n| Exp40-18 |      33 |   31 |    11 |    77 |    20 |    54 |     8 |    41 |     6 |    17 |   35 |   39 |\n| Exp40-19 |      32 |   31 |    11 |    76 |    20 |    53 |     8 |    40 |     5 |    16 |   34 |   39 |\n| Exp40-20 |      32 |   31 |    11 |    76 |    20 |    53 |     9 |    40 |     6 |    17 |   35 |   39 |\n| Exp40-21 |      32 |   31 |    11 |    76 |    20 |    52 |     9 |    40 |     6 |    16 |   34 |   39 |\n| Exp40-22 |      31 |   30 |    11 |    75 |    20 |    52 |     9 |    40 |     6 |    16 |   34 |   39 |\n| Exp40-23 |      31 |   30 |    10 |    75 |    19 |    51 |     8 |    39 |     5 |    16 |   34 |   38 |\n| Exp40-24 |      31 |   30 |    11 |    75 |    19 |    51 |     9 |    39 |     6 |    16 |   34 |   38 |\n| Exp40-25 |      30 |   30 |    10 |    74 |    19 |    51 |     8 |    38 |     5 |    15 |   33 |   38 |\n| Exp40-26 |      30 |   29 |    10 |    74 |    18 |    50 |     7 |    38 |     4 |    15 |   33 |   38 |\n| Exp40-27 |      30 |   29 |    10 |    74 |    18 |    50 |     8 |    38 |     5 |    15 |   33 |   38 |\n| Exp40-28 |      29 |   29 |    10 |    73 |    18 |    50 |     7 |    38 |     5 |    15 |   33 |   38 |"
  }
}