TRUSTING IPSLCM6.2 at TGCC irene-skylake


by J. Ghattas, IPSL
This trusting evaluates the technical issues with the coupled configuration IPSLCM6.2 at irene-skylake/TGCC. Each

Each line in the grey table corresponds to a specific installation of IPSLCM6.2 and all related tests. The revision number of
modipsl is set in column 2 and the revsion numbers for the other components are listed in the end of the line.
The 7th column shows the reference revision of modipsl which is used for comparing results for the individual tests.

The different tests listed in the table below are given on following syntax:
XXXXyz : XXXX= subconfig, y=p/d compilation in prod or debug mode, z=1 or 2 for different tests with different PeriodLength.
For example
LRp1 - subconfig LR with production mode compiled execuatble test 1 with PeriodLength=5D, total lenght 10days.
LRp2 - subconfig LR with production mode compiled execuatble test 2 with PeriodLength=10D, total lenght 10days.
LRd1 - subconfig LR with debug mode compiled execuatble test 1 with PeriodLength=1D, total lenght 2days.

The tests of type LRp1 = LRp2, are validating the restartability of the model. Both tests have the same total length but different PeriodLenth. The results should be the same in the end of the run.
The RealCpu time noted for each test concerns the last executed period only.

2021-10-06T16:10

IOIPSL svn checkout -r 5635 http://forge.ipsl.jussieu.fr/igcmg/svn/IOIPSL/tags/v2_2_5@5635 IOIPSL
ORCHIDEE svn checkout -r 7309 svn://forge.ipsl.jussieu.fr/orchidee/branches/ORCHIDEE_2_2/ORCHIDEE@7309 ORCHIDEE
oasis3-mct svn checkout -r 4775 http://forge.ipsl.jussieu.fr/igcmg/svn/CPL/oasis3-mct/branches/OASIS3-MCT_2.0_branch@4775 oasis3-mct
LMDZ svn checkout -r 3945 https://svn.lmd.jussieu.fr/LMDZ/LMDZ6/trunk@3945 LMDZ
IPSLCM6 svn checkout -r 5645 http://forge.ipsl.jussieu.fr/igcmg/svn/CONFIG/UNIFORM/v6/IPSLCM6.2@5645 IPSLCM6
libIGCM svn checkout -r 1545 http://forge.ipsl.jussieu.fr/libigcm/svn/trunk/libIGCM@1545 libIGCM
NEMOGCM@9455 svn checkout -r 9455 http://forge.ipsl.jussieu.fr/nemo/svn/branches/2015/nemo_v3_6_STABLE/NEMOGCM@9455
ORCA1_LIM3_PISCES@303 svn checkout -r 303 http://forge.ipsl.jussieu.fr/shaconemo/svn/trunk/ORCA1_LIM3_PISCES@303
ORCA025_LIM3_PISCES@303 svn checkout -r 303 http://forge.ipsl.jussieu.fr/shaconemo/svn/trunk/ORCA025_LIM3_PISCES@303
INCA svn checkout -r 915 --username inca http://forge.ipsl.jussieu.fr/inca/svn/trunk/INCA6@915 INCA
XIOS svn checkout -r 2029 http://forge.ipsl.jussieu.fr/ioserver/svn/XIOS/trunk@2029 XIOS


Date modipsl revision Status Compilation Other information Trusting level Reference modipsl revision All tests => LRp1 (prod,5D) LRp2 (prod,10D) LRd1 (debug,1D) LRp1 = LRp2 LMDZORp1 (prod,5D) LMDZORp2 (prod,10D) LMDZORd1 (debug,1D) LMDZORp1 = LMDZORp2 ESMCO2p1 (prod,5D) ESMCO2p2 (prod,10D) ESMCO2d1 (debug,1D) ESMCO2p1 = ESMCO2p2 MR025p1 (prod,1D) ESMAERp1 (prod,5D) ESMAERp2 (prod,10D) ESMAERd1 (debug,1D) ESMAERp1 = ESMAERp2 . . . IOIPSL ORCHIDEE oasis3-mct LMDZ IPSLCM6 libIGCM NEMOGCM ORCA1_LIM3_PISCES ORCA025_LIM3_PISCES INCA XIOS XIOS/arch ... ..
2019-09-16T10:57 4704 FAILED OK Take as new ref. This version still has problems with 1+1=2 in coupled mode. 6 4700modif2 Restart OK. RealCpuTime=130.580 Restart OK. RealCpuTime=192.820 Restart OK. RealCpuTime=234.550 Error: Restart differ err=1536. Restart OK. RealCpuTime=74.400 Restart OK. RealCpuTime=226.020 Restart OK. RealCpuTime=87.830 Restart OK but err=1. Restart OK. RealCpuTime=129.160 Restart OK. RealCpuTime=244.100 Restart OK. RealCpuTime=239.190 Error: Restart differ err=1617. solver.stat differ --- --- --- --- 4432 6189 1818 3559 4701 1486 9455 287 287 - 1659
2019-09-17T15:46 4710 FAILED OK ESM-AER with INCA introduced, take as new ref. 8 4704 Restart OK. RealCpuTime=127.810 Restart OK. RealCpuTime=191.750 Restart OK. RealCpuTime=234.800 Error: Restart differ err=1536. Restart OK. RealCpuTime=122.370 Restart OK. RealCpuTime=228.290 Fatal Restart OK but err=1. Restart OK. RealCpuTime=166.490 Restart OK. RealCpuTime=237.240 Restart OK. RealCpuTime=241.640 Error: Restart differ err=1617. solver.stat OK Restart differ err=300. RealCpuTime=313.170 Restart differ err=300. RealCpuTime=516.380 Restart differ err=300. RealCpuTime=642.230 Error: Restart differ err=4062. 4432 6189 1818 3559 4707 1488 9455 287 287 873 1659
2019-09-20T04:51 4721 DIFFER OK Results changed due to change in opa.driver to resolve 1+1=2 problem, see rev 4720 and 4721. Take as new ref. 8 4710 Restart differ err=1823. RealCpuTime=130.760 Restart OK. RealCpuTime=193.100 Restart differ err=1587. RealCpuTime=250.000 Restart OK. Restart OK. RealCpuTime=72.590 Restart OK. RealCpuTime=228.060 Restart OK. RealCpuTime=88.700 Restart OK but err=1. Restart differ err=1893. RealCpuTime=133.490 Restart OK. RealCpuTime=235.900 Restart differ err=1653. RealCpuTime=237.180 Restart OK but err=2. solver.stat OK Restart differ err=4346. RealCpuTime=314.460 Restart OK. RealCpuTime=526.060 Restart differ err=4110. RealCpuTime=638.310 Restart OK. 4432 6189 1818 3559 4721 1488 9455 287 287 873 1659
2019-10-01T16:48 4740 FAILED OK 8 4721 Restart OK. RealCpuTime=130.900 Restart OK. RealCpuTime=197.550 Restart OK. RealCpuTime=236.740 Restart OK. Restart OK. RealCpuTime=73.500 Restart OK. RealCpuTime=227.720 Fatal Restart OK but err=1. Restart OK. RealCpuTime=130.920 Restart OK. RealCpuTime=247.680 Restart OK. RealCpuTime=236.940 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=317.880 Restart OK. RealCpuTime=527.320 Restart OK. RealCpuTime=641.840 Restart OK. 4432 6189 1818 3559 4722 1488 9455 287 287 873 1659
2019-10-01T16:48 4740 OK OK Test trustLMDZORd1 has been relaunched manually. This test is still unstable. 8 4721 Restart OK. RealCpuTime=130.900 Restart OK. RealCpuTime=197.550 Restart OK. RealCpuTime=236.740 Restart OK. Restart OK. RealCpuTime=73.500 Restart OK. RealCpuTime=227.720 Restart OK. RealCpuTime=87.590 Restart OK but err=1. Restart OK. RealCpuTime=130.920 Restart OK. RealCpuTime=247.680 Restart OK. RealCpuTime=236.940 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=317.880 Restart OK. RealCpuTime=527.320 Restart OK. RealCpuTime=641.840 Restart OK. 4432 6189 1818 3559 4722 1488 9455 287 287 873 1659
2019-10-22T11:20 4767 DIFFER OK 8 4721 Restart differ err=1856. RealCpuTime=134.010 Restart differ err=1856. RealCpuTime=190.190 Restart differ err=1815. RealCpuTime=236.950 Restart OK. Restart differ err=1301. RealCpuTime=73.000 Restart differ err=1301. RealCpuTime=233.720 Restart differ err=1184. RealCpuTime=88.320 Restart OK but err=1. Restart differ err=1972. RealCpuTime=124.150 Restart differ err=1972. RealCpuTime=221.350 Restart differ err=1928. RealCpuTime=242.550 Restart OK but err=2. solver.stat differ Restart differ err=4384. RealCpuTime=317.930 Restart differ err=4384. RealCpuTime=529.780 Restart differ err=4337. RealCpuTime=643.370 Restart OK. 4432 6189 1818 3559 4722 1488 9455 287 287 873 1659
2019-11-08T17:15 4796 DIFFER OK Results changed due to new revisions of components (LMDZ and ORCHIDEE). Take as new ref. 8 4721 Restart differ err=1027. RealCpuTime=138.370 Restart differ err=1027. RealCpuTime=202.090 Restart differ err=1027. RealCpuTime=244.870 Restart OK. Restart differ err=951. RealCpuTime=86.220 Restart differ err=951. RealCpuTime=252.990 Restart differ err=901. RealCpuTime=96.970 Restart OK but err=1. Restart differ err=1106. RealCpuTime=121.980 Restart differ err=1106. RealCpuTime=224.500 Restart differ err=1106. RealCpuTime=246.180 Restart OK but err=2. solver.stat differ Restart differ err=3554. RealCpuTime=320.830 Restart differ err=3554. RealCpuTime=531.330 Restart differ err=3542. RealCpuTime=660.330 Restart OK. 4747 6319 4775 3599 4795 1493 9455 287 287 879 1659 1735
2019-12-04T10:35 4855 OK OK 8 4796 Restart OK. RealCpuTime=133.250 Restart OK. RealCpuTime=194.340 Restart OK. RealCpuTime=250.940 Restart OK. Restart OK. RealCpuTime=75.070 Restart OK. RealCpuTime=231.530 Restart OK. RealCpuTime=96.390 Restart OK but err=1. Restart OK. RealCpuTime=123.640 Restart OK. RealCpuTime=224.400 Restart OK. RealCpuTime=239.780 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=318.830 Restart OK. RealCpuTime=532.090 Restart OK. RealCpuTime=661.530 Restart OK. 4747 6372 4775 3599 4846 1507 9455 287 287 879 1778
2019-12-17T13:54 4865 FAILED OK 8 4796 Restart differ err=1872. RealCpuTime=135.530 Restart differ err=1872. RealCpuTime=203.290 Fatal Restart OK. Restart differ err=1314. RealCpuTime=77.970 Restart differ err=1314. RealCpuTime=231.470 Fatal Restart OK but err=1. Fatal Fatal Fatal Fatal. solver.stat differ Running Running Running Fatal. 4747 6372 4775 3599 4861 1509 9455 287 287 879 1778
2020-02-07T16:15 4918 OK OK 8 4796 Restart OK. RealCpuTime=134.530 Restart OK. RealCpuTime=199.780 Restart OK. RealCpuTime=243.420 Restart OK. Restart OK. RealCpuTime=73.830 Restart OK. RealCpuTime=227.660 Restart OK. RealCpuTime=97.290 Restart OK but err=1. Restart OK. RealCpuTime=122.850 Restart OK. RealCpuTime=232.660 Restart OK. RealCpuTime=239.440 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=304.360 Restart OK. RealCpuTime=511.140 Restart OK. RealCpuTime=638.690 Restart OK. 4747 6372 4775 3599 4918 1515 9455 287 287 879 1778
2020-02-24T17:37 4975 OK OK 8 4796 Restart OK. RealCpuTime=125.710 Restart OK. RealCpuTime=192.950 Restart OK. RealCpuTime=238.480 Restart OK. Restart OK. RealCpuTime=68.300 Restart OK. RealCpuTime=220.800 Restart OK. RealCpuTime=88.690 Restart OK but err=1. Restart OK. RealCpuTime=115.460 Restart OK. RealCpuTime=218.680 Restart OK. RealCpuTime=238.520 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=296.670 Restart OK. RealCpuTime=500.090 Restart OK. RealCpuTime=626.440 Restart OK. 4931 6372 4775 3599 4975 1517 9455 287 287 879 1778
2020-03-09T11:46 5008 FAILED OK All experience with ESMAER failed due to changeset 5005 or 5006 in config IPSLCM6. 8 4796 Restart OK. RealCpuTime=125.030 Restart OK. RealCpuTime=185.490 Restart OK. RealCpuTime=237.070 Restart OK. Restart OK. RealCpuTime=69.050 Restart OK. RealCpuTime=225.940 Restart OK. RealCpuTime=96.390 Restart OK but err=1. Restart OK. RealCpuTime=119.450 Restart OK. RealCpuTime=220.410 Restart OK. RealCpuTime=241.580 Restart OK but err=2. solver.stat OK Fatal Fatal Fatal Fatal. 4931 6372 4775 3599 5006 1517 9455 287 287 879 1778
2020-03-20T18:00 5023 DIFFER OK Results changed due to new revisions in mod.def. Take as new ref. 8 4796 Restart differ err=1872. RealCpuTime=125.670 Restart differ err=1872. RealCpuTime=187.110 Restart differ err=1830. RealCpuTime=240.490 Restart OK. Restart differ err=1314. RealCpuTime=67.710 Restart differ err=1314. RealCpuTime=220.880 Restart OK. RealCpuTime=96.070 Restart OK but err=1. Restart differ err=1991. RealCpuTime=117.900 Restart differ err=1991. RealCpuTime=216.590 Restart differ err=1942. RealCpuTime=242.610 Restart OK but err=2. solver.stat OK Restart differ err=4397. RealCpuTime=291.770 Restart differ err=4397. RealCpuTime=493.740 Restart differ err=4344. RealCpuTime=584.410 Restart OK. 5010 6594 4775 3651 5020 1522 9455 287 287 897 1862
2020-04-01T20:52 5047 FAILED FAILED 8 5027 Restart OK. RealCpuTime=129.130 Restart OK. RealCpuTime=193.720 Restart OK. RealCpuTime=237.220 Restart OK. Restart OK. RealCpuTime=69.130 Restart OK. RealCpuTime=225.050 Fatal Restart OK but err=1. Restart OK. RealCpuTime=117.440 Restart OK. RealCpuTime=225.200 Restart OK. RealCpuTime=237.520 Restart OK but err=2. solver.stat differ Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished --- 5010 6594 4775 3651 5034 1523 9455 287 287 910 1862
2020-04-03T18:55 5050 FAILED FAILED Error in checkout 8 5027 Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished --- Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished --- Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished --- Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished ---
2020-04-06T07:25 5050 FAILED FAILED Error in checkout 8 5027 Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished --- Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished --- Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished --- Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished ---
2020-04-06T19:16 5053 FAILED FAILED Error in checkout 8 5027 Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished --- Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished --- Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished --- Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished ---
2020-04-08T16:55 5055 OK OK Slight modif for LMDZ svn. Taken as new ref. 8 5055 Restart OK. RealCpuTime=126.580 Restart OK. RealCpuTime=189.430 Restart OK. RealCpuTime=235.720 Restart OK. Restart OK. RealCpuTime=68.440 Restart OK. RealCpuTime=221.260 Restart OK. RealCpuTime=194.690 Restart OK but err=1. Restart OK. RealCpuTime=118.280 Restart OK. RealCpuTime=219.940 Restart OK. RealCpuTime=236.090 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=300.920 Restart OK. RealCpuTime=595.980 Restart OK. RealCpuTime=588.310 Restart OK. 5010 6594 4775 3651 5034 1523 9455 287 287 915 1862
2020-04-09T17:05 5059 FAILED FAILED Error in checkout 8 5055 Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished --- Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished --- Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished --- Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished Compilation failed or not yet finished ---
2020-04-10T10:29 5060 OK OK Slight modif for LMDZ svn. 8 5055 Restart OK. RealCpuTime=140.210 Restart OK. RealCpuTime=185.840 Restart OK. RealCpuTime=237.220 Restart OK. Restart OK. RealCpuTime=69.050 Restart OK. RealCpuTime=218.280 Restart OK. RealCpuTime=87.920 Restart OK but err=1. Restart OK. RealCpuTime=118.810 Restart OK. RealCpuTime=212.390 Restart OK. RealCpuTime=274.160 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=293.770 Restart OK. RealCpuTime=494.380 Restart OK. RealCpuTime=594.350 Restart OK. 5058 6594 4775 3651 5034 1523 9455 287 287 915 1862
2020-06-18T00:32 5116 OK OK 8 5055 Restart OK. RealCpuTime=130.390 Restart OK. RealCpuTime=187.240 Restart OK. RealCpuTime=237.400 Restart OK. Restart OK. RealCpuTime=69.390 Restart OK. RealCpuTime=219.720 Restart OK. RealCpuTime=88.800 Restart OK but err=1. Restart OK. RealCpuTime=115.360 Restart OK. RealCpuTime=213.760 Restart OK. RealCpuTime=234.010 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=293.320 Restart OK. RealCpuTime=501.700 Restart OK. RealCpuTime=586.260 Restart OK. 5058 6594 4775 3651 5034 1534 9455 287 287 915 1866
2020-12-11T05:20 5522 FAILED OK solver.stat differ due to NEMO change. Defined as new ref. 8 5055 Restart OK. RealCpuTime=127.680 Restart OK. RealCpuTime=190.600 Restart OK. RealCpuTime=235.610 Restart OK. Restart OK. RealCpuTime=66.700 Restart OK. RealCpuTime=219.770 Restart OK. RealCpuTime=86.680 Restart OK but err=1. Restart OK. RealCpuTime=117.720 Restart OK. RealCpuTime=214.360 Restart OK. RealCpuTime=235.610 Restart OK but err=2. solver.stat differ Restart OK. RealCpuTime=293.220 Restart OK. RealCpuTime=496.300 Restart OK. RealCpuTime=588.760 Restart OK. 5058 6594 4775 3721 5519 1542 9455 295 295 915 1866
2021-02-08T16:20 5580 OK OK 8 5522 Restart OK. RealCpuTime=130.280 Restart OK. RealCpuTime=185.080 Restart OK. RealCpuTime=232.850 Restart OK. Restart OK. RealCpuTime=66.570 Restart OK. RealCpuTime=220.600 Restart OK. RealCpuTime=87.260 Restart OK but err=1. Restart OK. RealCpuTime=111.180 Restart OK. RealCpuTime=214.530 Restart OK. RealCpuTime=273.950 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=291.220 Restart OK. RealCpuTime=488.590 Restart OK. RealCpuTime=580.800 Restart OK. 5058 6594 4775 3721 5561 1545 9455 295 295 915 1866
2021-02-08T16:20 5580 OK OK 8 5522 Restart OK. RealCpuTime=130.280 Restart OK. RealCpuTime=185.080 Restart OK. RealCpuTime=232.850 Restart OK. Restart OK. RealCpuTime=66.570 Restart OK. RealCpuTime=220.600 Restart OK. RealCpuTime=87.260 Restart OK but err=1. Restart OK. RealCpuTime=111.180 Restart OK. RealCpuTime=214.530 Restart OK. RealCpuTime=273.950 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=291.220 Restart OK. RealCpuTime=488.590 Restart OK. RealCpuTime=580.800 Restart OK. 5058 6594 4775 3721 5561 1545 9455 295 295 915 1866
2021-03-01T15:18 5601 FAILED OK 8 5522 Fatal Fatal Fatal Fatal. Fatal Fatal Fatal Fatal. Restart differ err=1992. RealCpuTime=112.860 Restart differ err=1992. RealCpuTime=208.480 Restart differ err=1945. RealCpuTime=233.060 Restart OK but err=2. solver.stat OK Restart differ err=4402. RealCpuTime=288.200 Restart differ err=4402. RealCpuTime=492.250 Restart differ err=4352. RealCpuTime=581.350 Restart OK. 5058 7086 4775 3855 5600 1545 9455 297 297 915 2029
2021-03-02T05:06 5607 DIFFER OK Repro lost due to t2m q2m update. Taken as new ref. 8 5522 Restart differ err=1874. RealCpuTime=119.900 Restart differ err=1874. RealCpuTime=182.230 Restart differ err=1827. RealCpuTime=232.720 Restart OK. Restart differ err=1315. RealCpuTime=68.070 Restart differ err=1315. RealCpuTime=215.960 Restart differ err=1191. RealCpuTime=88.860 Restart OK but err=1. Restart differ err=1992. RealCpuTime=112.370 Restart differ err=1992. RealCpuTime=209.180 Restart differ err=1945. RealCpuTime=232.570 Restart OK but err=2. solver.stat OK Restart differ err=4402. RealCpuTime=289.590 Restart differ err=4402. RealCpuTime=494.240 Restart differ err=4352. RealCpuTime=581.610 Restart OK. 5058 7086 4775 3855 5602 1545 9455 297 297 915 2029
2021-04-29T21:01 5698 OK OK Reproducing 5607 after maintenance. 8 5607 Restart OK. RealCpuTime=156.490 Restart OK. RealCpuTime=222.950 Restart OK. RealCpuTime=274.220 Restart OK. Restart OK. RealCpuTime=76.130 Restart OK. RealCpuTime=225.480 Restart OK. RealCpuTime=103.140 Restart OK but err=1. Restart OK. RealCpuTime=162.220 Restart OK. RealCpuTime=235.230 Restart OK. RealCpuTime=278.190 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=313.960 Restart OK. RealCpuTime=505.750 Restart OK. RealCpuTime=891.240 Restart OK. 5058 7086 4775 3855 5602 1545 9455 297 297 915 2029
2021-05-16T23:47 5720 FAILED OK Taken as new ref. 8 5607 Restart differ err=1871. RealCpuTime=144.340 Restart differ err=1871. RealCpuTime=192.900 Restart OK. RealCpuTime=254.240 Restart OK. Restart differ err=1315. RealCpuTime=72.270 Restart differ err=1315. RealCpuTime=224.530 Restart OK. RealCpuTime=92.110 Restart OK but err=1. Restart differ err=1986. RealCpuTime=119.550 Restart differ err=1992. RealCpuTime=219.300 Restart differ err=1952. RealCpuTime=238.570 Error: Restart differ err=1618. solver.stat differ Restart differ err=4399. RealCpuTime=306.110 Restart differ err=4399. RealCpuTime=751.080 Restart OK. RealCpuTime=606.400 Restart OK. 5058 7086 4775 3872 5602 1545 9455 297 297 915 2029
2021-05-20T10:56 5726 FAILED OK 8 5720 Restart OK. RealCpuTime=143.730 Restart OK. RealCpuTime=214.700 Restart OK. RealCpuTime=254.390 Restart OK. Restart OK. RealCpuTime=75.180 Restart OK. RealCpuTime=231.860 Fatal Restart OK but err=1. Restart OK. RealCpuTime=129.460 Restart OK. RealCpuTime=235.120 Restart OK. RealCpuTime=256.670 Error: Restart differ err=1618. solver.stat OK Restart OK. RealCpuTime=306.440 Restart OK. RealCpuTime=521.990 Restart OK. RealCpuTime=611.210 Restart OK. 5635 7086 4775 3872 5645 1545 9455 303 303 915 2029
2021-05-22T03:28 5727 DIFFER OK Local modifications done. 8 5720 Restart OK. RealCpuTime=145.400 Restart OK. RealCpuTime=205.360 Restart OK. RealCpuTime=251.810 Restart OK. Restart OK. RealCpuTime=68.730 Restart OK. RealCpuTime=224.930 Restart OK. RealCpuTime=101.690 Restart OK but err=1. Restart OK. RealCpuTime=126.070 Restart OK. RealCpuTime=228.720 Restart OK. RealCpuTime=244.040 Error: Restart differ err=1618. solver.stat OK Restart OK. RealCpuTime=312.370 Restart OK. RealCpuTime=495.170 Restart OK. RealCpuTime=592.660 Restart OK. 5635 7086 4775 3865 5645 1545 9455 303 303 915 2029
2021-05-23T20:02 5727 DIFFER OK Local modifications done. 8 5720 Restart OK. RealCpuTime=138.310 Restart OK. RealCpuTime=192.760 Restart OK. RealCpuTime=246.000 Restart OK. Restart OK. RealCpuTime=70.870 Restart OK. RealCpuTime=223.420 Restart OK. RealCpuTime=90.500 Restart OK but err=1. Restart OK. RealCpuTime=139.670 Restart OK. RealCpuTime=222.440 Restart OK. RealCpuTime=243.230 Error: Restart differ err=1618. solver.stat OK Restart OK. RealCpuTime=292.680 Restart OK. RealCpuTime=491.190 Restart OK. RealCpuTime=588.490 Restart OK. 5635 7086 4775 3859 5645 1545 9455 303 303 915 2029
2021-06-07T03:42 5850 FAILED OK Local modifications done. 8 5720 Restart OK. RealCpuTime=138.770 Restart OK. RealCpuTime=189.500 Restart OK. RealCpuTime=241.490 Restart OK. Restart OK. RealCpuTime=70.220 Restart OK. RealCpuTime=222.240 Restart OK. RealCpuTime=104.610 Restart OK but err=1. Restart differ err=1994. RealCpuTime=117.420 Restart differ err=1995. RealCpuTime=207.900 Restart differ err=1952. RealCpuTime=241.580 Restart OK but err=2. solver.stat differ Restart OK. RealCpuTime=295.940 Restart OK. RealCpuTime=496.600 Restart OK. RealCpuTime=587.220 Restart OK. 5635 7086 4775 3845 5645 1545 9455 303 303 915 2029
2021-06-10T18:53 5853 DIFFER OK Manual fix for 1+1=2 in ESMCO2. Taken as new ref. 8 5720 Restart OK. RealCpuTime=146.670 Restart OK. RealCpuTime=201.910 Restart OK. RealCpuTime=243.880 Restart OK. Restart OK. RealCpuTime=68.900 Restart OK. RealCpuTime=233.640 Restart OK. RealCpuTime=105.380 Restart OK but err=1. Restart differ err=1903. RealCpuTime=151.500 Restart OK. RealCpuTime=229.140 Restart differ err=1667. RealCpuTime=261.490 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=309.710 Restart OK. RealCpuTime=499.860 Restart OK. RealCpuTime=624.610 Restart OK. 5635 7086 4775 3859 5645 1545 9455 303 303 915 2029
2021-06-16T06:16 5854 FAILED OK 8 5853 Restart OK. RealCpuTime=149.270 Restart OK. RealCpuTime=200.680 Restart OK. RealCpuTime=261.920 Restart OK. Restart OK. RealCpuTime=73.510 Restart OK. RealCpuTime=259.690 Fatal Restart OK but err=1. Restart OK. RealCpuTime=131.590 Restart OK. RealCpuTime=218.960 Restart OK. RealCpuTime=265.830 Restart OK but err=2. solver.stat OK Fatal Fatal Fatal Fatal. 5635 7086 4775 3933 5645 1545 9455 303 303 915 2029
2021-06-23T09:17 5860 OK OK Taken as new ref. 8 5853 Restart OK. RealCpuTime=234.990 Restart OK. RealCpuTime=247.010 Restart OK. RealCpuTime=319.120 Restart OK. Restart OK. RealCpuTime=92.330 Restart OK. RealCpuTime=246.170 Restart OK. RealCpuTime=122.400 Restart OK but err=1. Restart OK. RealCpuTime=189.560 Restart OK. RealCpuTime=295.700 Restart OK. RealCpuTime=328.220 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=340.360 Restart OK. RealCpuTime=593.700 Restart OK. RealCpuTime=636.930 Restart OK. 5635 7086 4775 3945 5645 1545 9455 303 303 915 2029
2021-07-03T04:31 5878 OK OK 8 5860 Restart OK. RealCpuTime=152.470 Restart OK. RealCpuTime=212.670 Restart OK. RealCpuTime=256.300 Restart OK. Restart OK. RealCpuTime=80.930 Restart OK. RealCpuTime=227.490 Restart OK. RealCpuTime=102.500 Restart OK but err=1. Restart OK. RealCpuTime=139.830 Restart OK. RealCpuTime=243.020 Restart OK. RealCpuTime=275.230 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=318.300 Restart OK. RealCpuTime=533.130 Restart OK. RealCpuTime=619.080 Restart OK. 5635 7086 4775 3945 5645 1545 9455 303 303 915 2029
2021-07-07T15:24 5879 OK OK After maintenance. 8 5860 Restart OK. RealCpuTime=123.970 Restart OK. RealCpuTime=191.410 Restart OK. RealCpuTime=243.780 Restart OK. Restart OK. RealCpuTime=88.480 Restart OK. RealCpuTime=227.210 Restart OK. RealCpuTime=97.940 Restart OK but err=1. Restart OK. RealCpuTime=114.930 Restart OK. RealCpuTime=218.760 Restart OK. RealCpuTime=242.560 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=295.420 Restart OK. RealCpuTime=500.450 Restart OK. RealCpuTime=589.790 Restart OK. 5635 7086 4775 3945 5645 1545 9455 303 303 915 2029
2021-09-17T10:43 5920 FAILED OK With improved -debug compilation options for LMDZ. 8 5860 Restart OK. RealCpuTime=165.780 Restart OK. RealCpuTime=210.560 Fatal Restart OK. Restart OK. RealCpuTime=83.690 Restart OK. RealCpuTime=246.380 Fatal Restart OK but err=1. Restart OK. RealCpuTime=181.160 Restart OK. RealCpuTime=289.580 Fatal Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=315.580 Restart OK. RealCpuTime=601.160 Fatal Restart OK. 5635 7086 4775 3945 5645 1545 9455 303 303 915 2029
2021-10-01T08:06 5930 OK OK After September maintenance. 8 5860 Restart OK. RealCpuTime=137.630 Restart OK. RealCpuTime=217.200 Restart OK. RealCpuTime=248.230 Restart OK. Restart OK. RealCpuTime=73.400 Restart OK. RealCpuTime=235.400 Restart OK. RealCpuTime=104.090 Restart OK but err=1. Restart OK. RealCpuTime=116.020 Restart OK. RealCpuTime=223.860 Restart OK. RealCpuTime=250.440 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=301.720 Restart OK. RealCpuTime=530.840 Restart OK. RealCpuTime=610.430 Restart OK. 5635 7086 4775 3945 5645 1545 9455 303 303 915 2029
2021-10-01T15:36 5930 OK OK With strong LMDZ -debug compilation options, and LMDZ_COSP_OK=n. 8 5860 Restart OK. RealCpuTime=126.630 Restart OK. RealCpuTime=220.820 Restart OK. RealCpuTime=297.690 Restart OK. Restart OK. RealCpuTime=72.340 Restart OK. RealCpuTime=228.970 Restart OK. RealCpuTime=166.940 Restart OK but err=1. Restart OK. RealCpuTime=120.720 Restart OK. RealCpuTime=222.660 Restart OK. RealCpuTime=307.020 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=307.840 Restart OK. RealCpuTime=539.760 Restart OK. RealCpuTime=887.910 Restart OK. 5635 7086 4775 3945 5645 1545 9455 303 303 915 2029
2021-10-05T14:03 5936 FAILED OK A test with LMDZ's trunk HEAD instead of rev3945. 8 5860 Restart OK. RealCpuTime=126.240 Restart OK. RealCpuTime=299.110 Fatal Restart OK. Restart OK. RealCpuTime=91.120 Restart OK. RealCpuTime=244.390 Fatal Restart OK but err=1. Restart OK. RealCpuTime=141.450 Restart OK. RealCpuTime=239.010 Fatal Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=299.080 Restart OK. RealCpuTime=521.750 Fatal Restart OK. 5635 7086 4775 3988 5645 1545 9455 303 303 915 2029
2021-10-06T00:10 5936 OK OK A test with LMDZ's trunk HEAD instead of rev3945, and LMDZ_COSP_OK=n. 8 5860 Restart OK. RealCpuTime=133.320 Restart OK. RealCpuTime=576.930 Restart OK. RealCpuTime=292.580 Restart OK. Restart OK. RealCpuTime=296.380 Restart OK. RealCpuTime=349.190 Restart OK. RealCpuTime=177.440 Restart OK but err=1. Restart OK. RealCpuTime=120.500 Restart OK. RealCpuTime=480.030 Restart OK. RealCpuTime=295.570 Restart OK but err=2. solver.stat OK Restart OK. RealCpuTime=298.530 Restart OK. RealCpuTime=515.700 Restart OK. RealCpuTime=890.240 Restart OK. 5635 7086 4775 3988 5645 1545 9455 303 303 915 2029
2021-10-06T16:10 5937 FAILED OK A test with ORCHIDEE_2_2 rev7309. 8 5860 Fatal Fatal Fatal Fatal. Restart differ err=1028. RealCpuTime=76.140 Restart differ err=1028. RealCpuTime=157.320 Restart differ err=951. RealCpuTime=99.320 Restart OK but err=1. Fatal Fatal Fatal Fatal. Fatal Fatal Fatal Fatal Fatal. 5635 7309 4775 3945 5645 1545 9455 303 303 915 2029