TRUSTING IPSLCM6.2 at TGCC irene-amd


by J. Ghattas, IPSL
This trusting evaluates the technical issues with the coupled configuration IPSLCM6.2 at irene-amd/TGCC. Each

Each line in the grey table corresponds to a specific installation of IPSLCM6.2 and all related tests. The revision number of
modipsl is set in column 2 and the revsion numbers for the other components are listed in the end of the line.
The 7th column shows the reference revision of modipsl which is used for comparing results for the individual tests.

The different tests listed in the table below are given on following syntax:
XXXXyz : XXXX= subconfig, y=p/d compilation in prod or debug mode, z=1 or 2 for different tests with different PeriodLength.
For example
LRp1 - subconfig LR with production mode compiled execuatble test 1 with PeriodLength=5D, total lenght 10days.
LRp2 - subconfig LR with production mode compiled execuatble test 2 with PeriodLength=10D, total lenght 10days.
LRd1 - subconfig LR with debug mode compiled execuatble test 1 with PeriodLength=1D, total lenght 2days.

The tests of type LRp1 = LRp2, are validating the restartability of the model. Both tests have the same total length but different PeriodLenth. The results should be the same in the end of the run.
The RealCpu time noted for each test concerns the last executed period only.

2021-10-01T08:07

IOIPSL svn checkout -r 5635 http://forge.ipsl.jussieu.fr/igcmg/svn/IOIPSL/tags/v2_2_5@5635 IOIPSL
ORCHIDEE svn checkout -r 7086 svn://forge.ipsl.jussieu.fr/orchidee/branches/ORCHIDEE_Quest/ORCHIDEE@7086 ORCHIDEE
oasis3-mct svn checkout -r 4775 http://forge.ipsl.jussieu.fr/igcmg/svn/CPL/oasis3-mct/branches/OASIS3-MCT_2.0_branch@4775 oasis3-mct
LMDZ svn checkout -r 3945 https://svn.lmd.jussieu.fr/LMDZ/LMDZ6/trunk@3945 LMDZ
IPSLCM6 svn checkout -r 5645 http://forge.ipsl.jussieu.fr/igcmg/svn/CONFIG/UNIFORM/v6/IPSLCM6.2@5645 IPSLCM6
libIGCM svn checkout -r 1545 http://forge.ipsl.jussieu.fr/libigcm/svn/trunk/libIGCM@1545 libIGCM
NEMOGCM@9455 svn checkout -r 9455 http://forge.ipsl.jussieu.fr/nemo/svn/branches/2015/nemo_v3_6_STABLE/NEMOGCM@9455
ORCA1_LIM3_PISCES@303 svn checkout -r 303 http://forge.ipsl.jussieu.fr/shaconemo/svn/trunk/ORCA1_LIM3_PISCES@303
ORCA025_LIM3_PISCES@303 svn checkout -r 303 http://forge.ipsl.jussieu.fr/shaconemo/svn/trunk/ORCA025_LIM3_PISCES@303
INCA svn checkout -r 915 --username inca http://forge.ipsl.jussieu.fr/inca/svn/trunk/INCA6@915 INCA
XIOS svn checkout -r 2029 http://forge.ipsl.jussieu.fr/ioserver/svn/XIOS/trunk@2029 XIOS


Date modipsl revision Status Compilation Other information Trusting level Reference modipsl revision . LRp1 (prod,5D) LRp2 (prod,10D) LRd1 (debug,1D) LRp1 = LRp2 LMDZORp1 (prod,5D) LMDZORp2 (prod,10D) LMDZORd1 (debug,1D) LMDZORp1 = LMDZORp2 ESMCO2p1 (prod,5D) ESMCO2p2 (prod,10D) ESMCO2d1 (debug,1D) ESMCO2p1 = ESMCO2p2 MR025p1 (prod,1D) ESMAERp1 (prod,5D) ESMAERp2 (prod,10D) ESMAERd1 (debug,1D) ESMAERp1 = ESMAERp2 . . . IOIPSL ORCHIDEE oasis3-mct LMDZ IPSLCM6 libIGCM NEMOGCM ORCA1_LIM3_PISCES ORCA025_LIM3_PISCES INCA XIOS ... ...
2020-04-03T15:48 5050 DIFFER OK 8 5023 Restart differ err=300. RealCpuTime=194.130 Restart differ err=300. RealCpuTime=277.500 Restart differ err=300. RealCpuTime=268.050 Error: Restart differ err=400. Restart differ err=300. RealCpuTime=73.400 Restart differ err=300. RealCpuTime=225.890 Restart differ err=300. RealCpuTime=91.940 Error: Restart differ err=400. Restart differ err=300. RealCpuTime=183.030 Restart differ err=300. RealCpuTime=289.170 Restart differ err=300. RealCpuTime=266.430 Error: Restart differ err=400. solver.stat OK Restart differ err=300. RealCpuTime=360.000 Restart differ err=300. RealCpuTime=569.790 Restart differ err=300. RealCpuTime=602.830 Error: Restart differ err=400. 5010 6594 4775 3651 5034 1523 9455 287 287 915 1862
2020-04-08T17:51 5055 OK OK Local modifications done. 8 5050 Restart OK. RealCpuTime=186.150 Restart OK. RealCpuTime=246.800 Restart OK. RealCpuTime=265.080 Restart OK. Restart OK. RealCpuTime=72.580 Restart OK. RealCpuTime=216.110 Restart OK. RealCpuTime=94.940 Restart OK but err=1. Restart OK. RealCpuTime=182.410 Restart OK. RealCpuTime=290.030 Restart OK. RealCpuTime=263.100 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=334.960 Restart OK. RealCpuTime=580.480 Restart OK. RealCpuTime=603.770 Restart OK. 5010 6594 4775 3651 5034 1523 9455 287 287 915 1862
2020-04-09T17:05 5059 FAILED FAILED Error in checkout 8 5050 Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished --- Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished --- Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished --- Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished ---
2020-04-10T10:30 5060 OK OK Slight modification for LMDZ svn. 8 5050 Restart OK. RealCpuTime=207.540 Restart OK. RealCpuTime=278.580 Restart OK. RealCpuTime=265.330 Restart OK. Restart OK. RealCpuTime=71.060 Restart OK. RealCpuTime=213.650 Restart OK. RealCpuTime=92.240 Restart OK but err=1. Restart OK. RealCpuTime=190.540 Restart OK. RealCpuTime=299.830 Restart OK. RealCpuTime=267.950 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=331.380 Restart OK. RealCpuTime=552.040 Restart OK. RealCpuTime=594.770 Restart OK. 5058 6594 4775 3651 5034 1523 9455 287 287 915 1862
2020-05-14T17:42 5093 OK OK Now running under devcmip6. 8 5050 Restart OK. RealCpuTime=192.380 Restart OK. RealCpuTime=282.320 Restart OK. RealCpuTime=272.090 Restart OK. Restart OK. RealCpuTime=72.720 Restart OK. RealCpuTime=216.420 Restart OK. RealCpuTime=93.750 Restart OK but err=1. Restart OK. RealCpuTime=180.980 Restart OK. RealCpuTime=288.180 Restart OK. RealCpuTime=265.600 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=335.280 Restart OK. RealCpuTime=550.460 Restart OK. RealCpuTime=594.270 Restart OK. 5058 6594 4775 3651 5034 1523 9455 287 287 915 1862
2020-05-20T16:53 5107 FAILED FAILED Error in extracting IPSLCM6.2_work config 8 5050 Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished --- Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished --- Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished --- Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished ---
2020-05-25T13:53 5107 OK OK 8 5050 Restart OK. RealCpuTime=201.920 Restart OK. RealCpuTime=327.910 Restart OK. RealCpuTime=266.340 Restart OK. Restart OK. RealCpuTime=82.520 Restart OK. RealCpuTime=288.720 Restart OK. RealCpuTime=92.370 Restart OK but err=1. Restart OK. RealCpuTime=183.490 Restart OK. RealCpuTime=288.440 Restart OK. RealCpuTime=265.170 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=331.460 Restart OK. RealCpuTime=558.150 Restart OK. RealCpuTime=597.030 Restart OK. 5058 6594 4775 3651 5034 1529 9455 287 287 915 1866
2020-06-17T16:56 5116 OK OK 8 5050 Restart OK. RealCpuTime=192.430 Restart OK. RealCpuTime=277.050 Restart OK. RealCpuTime=267.890 Restart OK. Restart OK. RealCpuTime=73.170 Restart OK. RealCpuTime=211.710 Restart OK. RealCpuTime=92.700 Restart OK but err=1. Restart OK. RealCpuTime=182.910 Restart OK. RealCpuTime=285.040 Restart OK. RealCpuTime=264.180 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=338.400 Restart OK. RealCpuTime=569.030 Restart OK. RealCpuTime=594.710 Restart OK. 5058 6594 4775 3651 5034 1534 9455 287 287 915 1866
2020-12-11T06:54 5522 FAILED OK 8 5050 Diffs due to machine changes. Taken as new ref. Restart differ err=1867. RealCpuTime=186.310 Restart differ err=1867. RealCpuTime=286.170 Restart differ err=1827. RealCpuTime=273.650 Restart OK. Restart differ err=1316. RealCpuTime=71.220 Restart differ err=1316. RealCpuTime=215.130 Restart differ err=1188. RealCpuTime=96.980 Restart OK but err=1. Restart differ err=1990. RealCpuTime=178.920 Restart differ err=1990. RealCpuTime=303.070 Restart differ err=1943. RealCpuTime=271.060 Restart OK but err=2. solver.stat differ Restart differ err=4397. RealCpuTime=356.830 Restart differ err=4397. RealCpuTime=587.740 Restart differ err=4342. RealCpuTime=607.260 Restart OK. 5058 6594 4775 3721 5519 1542 9455 295 295 915 1866
2021-02-08T09:05 5579 OK OK 8 5522 Restart OK. RealCpuTime=190.450 Restart OK. RealCpuTime=3557.050 Restart OK. RealCpuTime=272.410 Restart OK. Restart OK. RealCpuTime=72.410 Restart OK. RealCpuTime=213.960 Restart OK. RealCpuTime=100.320 Restart OK but err=1. Restart OK. RealCpuTime=193.490 Restart OK. RealCpuTime=298.710 Restart OK. RealCpuTime=282.860 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=3877.000 Restart OK. RealCpuTime=593.620 Restart OK. RealCpuTime=604.760 Restart OK. 5058 6594 4775 3721 5561 1545 9455 295 295 915 1866
2021-03-01T15:17 5601 FAILED OK 8 5522 Fatal Fatal Fatal Fatal. Fatal Fatal Fatal Fatal. Restart differ err=1987. RealCpuTime=176.920 Restart differ err=1987. RealCpuTime=268.520 Restart differ err=1942. RealCpuTime=274.690 Restart OK but err=2. solver.stat OK Restart differ err=4399. RealCpuTime=361.920 Restart differ err=4399. RealCpuTime=595.130 Restart differ err=4348. RealCpuTime=604.940 Restart OK. 5058 7086 4775 3855 5600 1545 9455 297 297 915 2029
2021-03-01T18:48 5607 DIFFER OK Repro lost due to t2m q2m fix. Taken as new ref. 8 5522 Restart differ err=1871. RealCpuTime=192.350 Restart differ err=1871. RealCpuTime=260.580 Restart differ err=1830. RealCpuTime=272.230 Restart OK. Restart differ err=1315. RealCpuTime=76.990 Restart differ err=1315. RealCpuTime=222.050 Restart differ err=1192. RealCpuTime=102.970 Restart OK but err=1. Restart differ err=1987. RealCpuTime=177.620 Restart differ err=1987. RealCpuTime=264.600 Restart differ err=1942. RealCpuTime=269.500 Restart OK but err=2. solver.stat OK Restart differ err=4399. RealCpuTime=361.750 Restart differ err=4399. RealCpuTime=599.210 Restart differ err=4348. RealCpuTime=604.780 Restart OK. 5058 7086 4775 3855 5602 1545 9455 297 297 915 2029
2021-04-30T04:16 5698 FAILED OK Trying to reproduce 5607 after maintenance. Taken as new ref. 8 5607 Restart differ err=1870. RealCpuTime=194.840 Restart differ err=1870. RealCpuTime=274.510 Restart differ err=1581. RealCpuTime=275.780 Restart OK. Restart OK. RealCpuTime=79.780 Restart OK. RealCpuTime=214.640 Restart OK. RealCpuTime=107.370 Restart OK but err=1. Restart differ err=1990. RealCpuTime=198.020 Restart differ err=1990. RealCpuTime=267.680 Restart differ err=1938. RealCpuTime=277.410 Restart OK but err=2. solver.stat differ Restart differ err=4366. RealCpuTime=365.310 Restart differ err=4366. RealCpuTime=591.820 Restart differ err=4106. RealCpuTime=600.620 Restart OK. 5058 7086 4775 3855 5602 1545 9455 297 297 915 2029
2021-05-03T07:52 5700 OK OK With 5698 as ref, trusting with same mod.def as 5607. 8 5698 Restart OK. RealCpuTime=203.660 Restart OK. RealCpuTime=249.020 Restart OK. RealCpuTime=277.110 Restart OK. Restart OK. RealCpuTime=74.770 Restart OK. RealCpuTime=228.550 Restart OK. RealCpuTime=105.480 Restart OK but err=1. Restart OK. RealCpuTime=179.750 Restart OK. RealCpuTime=276.890 Restart OK. RealCpuTime=270.960 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=386.720 Restart OK. RealCpuTime=620.620 Restart OK. RealCpuTime=634.890 Restart OK. 5058 7086 4775 3855 5602 1545 9455 297 297 915 2029
2021-05-20T14:18 5727 FAILED OK Taken as new ref. 8 5698 Restart differ err=1872. RealCpuTime=210.190 Restart differ err=1872. RealCpuTime=284.630 Restart OK. RealCpuTime=278.920 Restart OK. Restart differ err=1315. RealCpuTime=84.860 Restart differ err=1315. RealCpuTime=236.530 Restart OK. RealCpuTime=98.320 Restart OK but err=1. Restart differ err=1990. RealCpuTime=174.270 Restart differ err=1987. RealCpuTime=288.190 Restart differ err=1942. RealCpuTime=268.940 Error: Restart differ err=1618. solver.stat differ Restart differ err=4400. RealCpuTime=365.750 Restart differ err=4400. RealCpuTime=629.690 Restart OK. RealCpuTime=637.510 Restart OK. 5058 7086 4775 3872 5602 1545 9455 297 297 915 2029
2021-06-26T14:55 5876 DIFFER OK Manual fix for 1+1=2 in ESMCO2. Taken as new ref. 8 5727 Restart OK. RealCpuTime=189.780 Restart OK. RealCpuTime=268.570 Restart OK. RealCpuTime=271.750 Restart OK. Restart OK. RealCpuTime=89.500 Restart OK. RealCpuTime=227.490 Restart OK. RealCpuTime=115.130 Restart OK but err=1. Restart differ err=1907. RealCpuTime=205.900 Restart OK. RealCpuTime=281.600 Restart differ err=1669. RealCpuTime=276.850 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=372.440 Restart OK. RealCpuTime=628.030 Restart OK. RealCpuTime=635.820 Restart OK. 5635 7086 4775 3859 5645 1545 9455 303 303 915 2029
2021-06-27T07:23 5876 FAILED OK Taken as new ref. 8 5876 Restart differ err=1871. RealCpuTime=187.110 Restart differ err=1871. RealCpuTime=261.810 Restart OK. RealCpuTime=287.160 Restart OK. Restart differ err=1315. RealCpuTime=83.470 Restart differ err=1315. RealCpuTime=241.310 Restart OK. RealCpuTime=114.590 Restart OK but err=1. Restart differ err=1991. RealCpuTime=184.580 Restart differ err=1991. RealCpuTime=270.650 Restart OK. RealCpuTime=290.390 Restart OK but err=2. solver.stat differ Restart differ err=4397. RealCpuTime=373.510 Restart differ err=4397. RealCpuTime=686.010 Restart OK. RealCpuTime=654.370 Restart OK. 5635 7086 4775 3945 5645 1545 9455 303 303 915 2029
2021-07-02T15:57 5877 OK OK 8 5876 Restart OK. RealCpuTime=193.890 Restart OK. RealCpuTime=308.840 Restart OK. RealCpuTime=289.030 Restart OK. Restart OK. RealCpuTime=87.290 Restart OK. RealCpuTime=252.410 Restart OK. RealCpuTime=128.620 Restart OK but err=1. Restart OK. RealCpuTime=209.730 Restart OK. RealCpuTime=294.050 Restart OK. RealCpuTime=304.280 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=419.840 Restart OK. RealCpuTime=659.590 Restart OK. RealCpuTime=646.820 Restart OK. 5635 7086 4775 3945 5645 1545 9455 303 303 915 2029
2021-07-09T10:15 5879 OK OK After maintenance. 8 5876 Restart OK. RealCpuTime=170.160 Restart OK. RealCpuTime=235.740 Restart OK. RealCpuTime=265.410 Restart OK. Restart OK. RealCpuTime=74.620 Restart OK. RealCpuTime=220.010 Restart OK. RealCpuTime=105.120 Restart OK but err=1. Restart OK. RealCpuTime=160.970 Restart OK. RealCpuTime=253.150 Restart OK. RealCpuTime=259.420 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=341.090 Restart OK. RealCpuTime=567.800 Restart OK. RealCpuTime=595.670 Restart OK. 5635 7086 4775 3945 5645 1545 9455 303 303 915 2029
2021-10-01T08:07 5930 OK OK After September maintenance. 8 5876 Restart OK. RealCpuTime=170.570 Restart OK. RealCpuTime=259.400 Restart OK. RealCpuTime=263.960 Restart OK. Restart OK. RealCpuTime=85.750 Restart OK. RealCpuTime=232.630 Restart OK. RealCpuTime=109.370 Restart OK but err=1. Restart OK. RealCpuTime=161.960 Restart OK. RealCpuTime=263.240 Restart OK. RealCpuTime=263.280 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=343.250 Restart OK. RealCpuTime=597.350 Restart OK. RealCpuTime=599.000 Restart OK. 5635 7086 4775 3945 5645 1545 9455 303 303 915 2029