Recent new failures

[seisman]

Recent changes have break many tests:

+ ctest --output-on-failure --force-new-ctest-process -j4 --timeout 480 --rerun-failed
Test project /home/runner/work/gmt/gmt/build
      Start    3: doc/scripts/GMT_-B_geo_2.sh
      Start  659: test/grdview/gouraud.sh
      Start  862: test/pscoast/pscoast_JE2.sh
      Start 1012: test/pstext/var_offset.sh
 1/11 Test  #862: test/pscoast/pscoast_JE2.sh ..........***Failed    0.48 sec
Set GMT_SESSION_NAME = 80584
pscoast (gmtlib_lonpath): Could not reallocate memory [68719476736.00 Gb, 9223372036854775809 items of 8 bytes]
pscoast (gmtlib_lonpath): Could not reallocate memory [68719476736.00 Gb, 9223372036854775809 items of 8 bytes]
ERROR: Caught signal number 11 (Segmentation fault) at
/home/runner/work/gmt/gmt/build/src/libgmt.so.6(gmtlib_lonpath+0x541)[0x7fd9a8342308]
[0x0]
Stack backtrace:
/home/runner/work/gmt/gmt/build/src/libgmt.so.6(gmt_sig_handler_unix+0x183)[0x7fd9a8275245]
/lib/x86_64-linux-gnu/libc.so.6(+0x45330)[0x7fd9a7c45330]
/home/runner/work/gmt/gmt/build/src/libgmt.so.6(gmtlib_lonpath+0x541)[0x7fd9a8342308]
/home/runner/work/gmt/gmt/build/src/libgmt.so.6(gmtlib_map_path+0xdc)[0x7fd9a8341dbc]
/home/runner/work/gmt/gmt/build/src/libgmt.so.6(gmt_assemble_shore+0x126b)[0x7fd9a81b0e68]
/home/runner/work/gmt/gmt/build/src/libgmt.so.6(GMT_pscoast+0x337a)[0x7fd9a8642214]
/home/runner/work/gmt/gmt/build/src/libgmt.so.6(GMT_Call_Module+0x843)[0x7fd9a80fb6b6]
/home/runner/work/gmt/gmt/build/src/gmt(+0x2f48)[0x5620e0c53f48]
/lib/x86_64-linux-gnu/libc.so.6(+0x2a1ca)[0x7fd9a7c2a1ca]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0x8b)[0x7fd9a7c2a28b]
/home/runner/work/gmt/gmt/build/src/gmt(+0x26f5)[0x5620e0c536f5]
ERROR: gmtest:90
memtrack errors: 0
exit status: 1
      Start 1034: test/psxy/bezier_demo_quadratic.sh
 2/11 Test #1012: test/pstext/var_offset.sh ............***Failed    1.24 sec
Set GMT_SESSION_NAME = 80587
/usr/bin/gm compare: image difference exceeds limit (0.00324132 > 0.003).
test/pstext/var_offset.ps: RMS Error = 0.0032 [FAIL]
memtrack errors: 0
exit status: 1
      Start 1168: test/psxyz/QR.sh
 3/11 Test    #3: doc/scripts/GMT_-B_geo_2.sh ..........***Failed    1.32 sec
Set GMT_SESSION_NAME = 80582
/usr/bin/gm compare: image difference exceeds limit (0.0123303 > 0.003).
doc/scripts/GMT_-B_geo_2.ps: RMS Error = 0.0123 [FAIL]
memtrack errors: 0
exit status: 1
      Start 1182: test/psxyz/matharc.sh
 4/11 Test #1168: test/psxyz/QR.sh .....................***Failed    1.29 sec
Set GMT_SESSION_NAME = 80788
/usr/bin/gm compare: image difference exceeds limit (0.164592 > 0.003).
test/psxyz/QR.ps: RMS Error = 0.1646 [FAIL]
memtrack errors: 0
exit status: 1
      Start 1193: test/psxyz/varwedges.sh
 5/11 Test #1182: test/psxyz/matharc.sh ................***Failed    1.32 sec
Set GMT_SESSION_NAME = 80806
/usr/bin/gm compare: image difference exceeds limit (0.136122 > 0.003).
test/psxyz/matharc.ps: RMS Error = 0.1361 [FAIL]
memtrack errors: 0
exit status: 1
      Start 1195: test/psxyz/vector.sh
 6/11 Test #1034: test/psxy/bezier_demo_quadratic.sh ...***Failed    2.24 sec
Set GMT_SESSION_NAME = 80696
/usr/bin/gm compare: image difference exceeds limit (0.0320449 > 0.003).
test/psxy/bezier_demo_quadratic.ps: RMS Error = 0.0320 [FAIL]
memtrack errors: 0
exit status: 1
      Start 1197: test/psxyz/wedges.sh
 7/11 Test #1193: test/psxyz/varwedges.sh ..............***Failed    1.32 sec
Set GMT_SESSION_NAME = 80934
/usr/bin/gm compare: image difference exceeds limit (0.112287 > 0.003).
test/psxyz/varwedges.ps: RMS Error = 0.1123 [FAIL]
memtrack errors: 0
exit status: 1
      Start 1206: test/segy/segy_03.sh
 8/11 Test #1197: test/psxyz/wedges.sh .................***Failed    1.33 sec
Set GMT_SESSION_NAME = 80980
/usr/bin/gm compare: image difference exceeds limit (0.112287 > 0.003).
test/psxyz/wedges.ps: RMS Error = 0.1123 [FAIL]
memtrack errors: 0
exit status: 1
 9/11 Test #1195: test/psxyz/vector.sh .................***Failed    1.42 sec
Set GMT_SESSION_NAME = 80961
/usr/bin/gm compare: image difference exceeds limit (0.159847 > 0.003).
test/psxyz/vector.ps: RMS Error = 0.1598 [FAIL]
memtrack errors: 0
exit status: 1
10/11 Test #1206: test/segy/segy_03.sh .................***Failed    0.97 sec
Set GMT_SESSION_NAME = 81100
/usr/bin/gm compare: image difference exceeds limit (0.28359 > 0.003).
test/segy/segy_03.ps: RMS Error = 0.2836 [FAIL]
memtrack errors: 0
exit status: 1
11/11 Test  #659: test/grdview/gouraud.sh ..............***Failed    5.00 sec
Set GMT_SESSION_NAME = 80583
/usr/bin/gm compare: image difference exceeds limit (0.266764 > 0.003).
test/grdview/gouraud.ps: RMS Error = 0.2668 [FAIL]
memtrack errors: 0
exit status: 1
0% tests passed, 11 tests failed out of 11
Total Test time (real) =   5.03 sec
The following tests FAILED:
	  3 - doc/scripts/GMT_-B_geo_2.sh (Failed)
	659 - test/grdview/gouraud.sh (Failed)
	862 - test/pscoast/pscoast_JE2.sh (Failed)
	1012 - test/pstext/var_offset.sh (Failed)
	1034 - test/psxy/bezier_demo_quadratic.sh (Failed)
	1168 - test/psxyz/QR.sh (Failed)
	1182 - test/psxyz/matharc.sh (Failed)
	1193 - test/psxyz/varwedges.sh (Failed)
	1195 - test/psxyz/vector.sh (Failed)
	1197 - test/psxyz/wedges.sh (Failed)
	1206 - test/segy/segy_03.sh (Failed)
Errors while running CTest
Error: Process completed with exit code 8.

[joa-quim]

I believe those are caused by the fix of -Xc-Yc in #9045 and now need the ps baseline to be updated

[joa-quim]

It's impossible to work with DVC. I updated more than half of those failures. But the tests keep failing.

[seisman]

I've updated the psxyz tests in #9052 and now they pass.

[seisman]

Lastest failures:

	  3 - doc/scripts/GMT_-B_geo_2.sh (Failed)
	213 - doc/examples/ex08/ex08.sh (Failed)
	542 - test/grdimage/globalgrid.sh (Failed)
	549 - test/grdimage/grdread.sh (Failed)
	863 - test/pscoast/pscoast_JE2.sh (Failed)
	1013 - test/pstext/var_offset.sh (Failed)
	1035 - test/psxy/bezier_demo_quadratic.sh (Failed)
	1207 - test/segy/segy_03.sh (Failed)

[seisman]

ex08 is badly broken, likely due to changes in 7b70493. Please don't merge changes unless all existing tests pass, otherwise we will likely introduce more serieos bugs when fixing small issues.

[joa-quim]

Problem is that the CIs fail so many times for unknown reasons that they became quite unreliable. And I run the test locally many times. The ex08 passes for me when I use GMT_DATA_SERVER static

[seisman]

Hmmm, not sure why I was getting an empty 3-D frame without any histograms, but now ex08 is looks correct with only slightly minor changes. I'll update the baseline image in PR #9055.

Problem is that the CIs fail so many times for unknown reasons that they have become quite unreliable.

Yes, it's a long term issue that the CIs, especially Linux, fails to fetch data from the GMT data server. It may be an issue of the CI, or an issue with the curl call in GMT.

[joa-quim]

But there must be something fishy on this. ETOPO5 grids are not updated, so why static and non static versions are different?

[seisman]

Here is the diff image. It seems the minor difference is caused by the two frame borders at the bottom of the 3D plot.

[joa-quim]

#8972 is on hold exactly due to problems similar to this (or were during the investigation phase).

[joa-quim]

Hard to tackle this one because I still cannot reproduce it locally. For me the test keeps passing.

[seisman]

The test/pstext/var_offset.sh test fails. I think the baseline image is correct, and the image generated by the master branch is wrong:

Baseline image	Incorrect image from master

[joa-quim]

No, current generated image is correct. What happens is that the connecting line is clipped by the text bbox after addressing #3927
I still intend to revisit this to see if the clipping can be made optional.