Random/sporadic failures running test suite interactively against Spike #1049

TommyMurphyTM1234 · 2024-04-21T12:26:59Z

I'm not sure if this should be logged here or in the test suite repo - but I'll log it here for now. :-)

I have built the latest toolchain and OpenOCD and am running the basic smoke tests against Spike:

https://github.com/riscv-software-src/riscv-tests/tree/master/debug#usage

but have been getting random/sporadic failures - e.g. the following from three separate attempts to run the smoke tests:

MemorySampleMixed: 20240421-125738-spike64-MemorySampleMixed.log
Registers: 20240421-130859-spike64-Registers.log
ProgramSwWatchpoint: 20240421-131950-spike64-ProgramSwWatchpoint.log

Does anybody know why this is happening?
In case it matters I'm doing this on a VirtualBox VM (host OS = Windows 10. guest OS = ZorinOS 17.1 Core) with what seems to be adequate resources (CPUs, memory, disk space etc.).

Maybe it's due to some local issue since the GitHib Action automated tests seem to be running OK?

https://github.com/riscv-collab/riscv-openocd/actions/workflows/spike-openocd-tests.yml

The text was updated successfully, but these errors were encountered:

TommyMurphyTM1234 · 2024-04-21T13:27:18Z

I just noticed that most if not all of the failures that I have encoutered seem to have this in common:

-------------------------[ /tmp/spike-m44a80hl.log ]--------------------------
+ spike -p1 --isa RV64IMAFC --dm-auth --dm-progsize 0 --dm-sba 64 --dm-abstract-rti 30 -m0x1212340000:0x10000000 --rbb-port 0 /tmp/spike64_checksum-8000000000141125_rtnb_spo
Listening for remote bitbang connection on port 41607.
warning: tohost and fromhost symbols not in ELF; can't communicate with target
Received nothing. Quitting.

-------------------------[ /tmp/openocdxsztiom6.log ]-------------------------
+ REMOTE_BITBANG_HOST=localhost REMOTE_BITBANG_PORT=41607 WORK_AREA=0x1212340000 USE_FREERTOS=0 openocd --command 'gdb_port 0' --command 'tcl_port 0' --command 'telnet_port disabled' -f targets/RISC-V/spike-1.cfg
Open On-Chip Debugger 0.12.0+dev-03744-g3991492cc-dirty (2024-04-19-19:06)
Licensed under GNU GPL v2
For bug reports, read
        http://openocd.org/doc/doxygen/bugs.html
Info : auto-selecting first available session transport "jtag". To override use 'transport select <transport>'.
Info : Initializing remote_bitbang driver
Info : Connecting to localhost:41607
Info : remote_bitbang driver initialized
Info : Note: The adapter "remote_bitbang" doesn't support configurable speed
Info : JTAG tap: riscv.cpu tap/device found: 0xdeadbeef (mfg: 0x777 (Fabric of Truth Inc), part: 0xeadb, ver: 0xd)
Warn : JTAG tap: riscv.cpu       UNEXPECTED: 0xdeadbeef (mfg: 0x777 (Fabric of Truth Inc), part: 0xeadb, ver: 0xd)
Error: JTAG tap: riscv.cpu  expected 1 of 1: 0x10e31913 (mfg: 0x489 (SiFive Inc), part: 0x0e31, ver: 0x1)
Error: Trying to use configured scan chain anyway...
Warn : Bypassing JTAG setup events due to errors
Error: Debugger is not authenticated to target Debug Module. (dmstatus=0x4c0c02). Use `riscv authdata_read` and `riscv authdata_write` commands to authenticate.
Error: [riscv.cpu] Examination failed
Warn : target riscv.cpu examination failed
Info : starting gdb server for riscv.cpu on 0
Info : Listening on port 38209 for gdb connections
Info : [riscv.cpu] authdata_write resulted in successful authentication
Info : [riscv.cpu] datacount=2 progbufsize=0
Warn : [riscv.cpu] We won't be able to execute fence instructions on this target. Memory may not always appear consistent. (progbufsize=0, impebreak=1)
Error: [riscv.cpu] Unable to insert program into progbuf, capacity would be exceeded (progbufsize=0).
Error: [riscv.cpu] Unable to insert program into progbuf, capacity would be exceeded (progbufsize=0).
Info : [riscv.cpu] Examined RISC-V core
Info : [riscv.cpu]  XLEN=64, misa=0x8000000000141125
[riscv.cpu] Target successfully examined.
Info : [riscv.cpu] Examination succeed
riscv.cpu halted due to debug-request.
semihosting is enabled
Info : Listening on port 36257 for tcl connections

Does anybody know why this might happen sporadically/randomly?

aap-sc · 2024-04-21T15:18:23Z

Does anybody know why this might happen sporadically/randomly?

Ah.. Sporadic failures. I've never encountered sporadic failures on these exact tests you've mentioned, but I have some experience with debugging sporadic failures in the test suite. For example, on the current TOT I periodically get sporadic failures of UnavailableMultiTest test (had not time to investigate it, yet)

A while ago there was an issue like this: riscv-software-src/riscv-tests#520 which was fixed here: riscv-software-src/riscv-tests#522 . Most likely there are still issues of these nature in the testsuite.

I also remember that some tests depend on host machine perfomance. For example I know that MemorySampleSingle is affected, see call to:

self.check_incrementing_samples(raw_samples, addr, tolerance=0x500000)

Internally at Syntacore we just patch-out the source code of this test for it to work on our CI machine. Again, had no time fix this one, it was easier to patch-out and forget about the problem.

I have suspicion that you may encounter issue of similar nature.

I'm not sure if this should be logged here or in the test suite repo - but I'll log it here for now. :-)

I would recommend to file the issue there. That being said - both me and @en-sc have write permissions to riscv-tests repository with an expectation that we do reviews/fixes. So at least you've notified us about the issue.

Now, if you need help with debugging these it would be great if you could produce test execution logs that capture this sporadic failure. Sometimes careful analysis of these logs is enough to debug the issue.

If you choose to attach log files, please run tests as follows (below is just an example):

gdbserver.py \
  $PLATFORM_NAME \
 --isolate \
 --logs $LOG_DIR \
 --gcc riscv64-unknown-elf-gcc \
 --gdb riscv64-unknown-elf-gdb \
  --sim_cmd spike --target-timeout 180 \
  --remotelogfile-enable \
  --server_cmd "$OPENCOD_BIN_PATH -d3'

Important arguments are:

--remotelogfile-enable enables logging for gdb-remote commands sent to OpenOCD by GDB. This is relatively new option that was added here: riscv-software-src/riscv-tests@b89570c
--server_cmd with -d3 option. d3 enables debug-level printing during openocd execution.

Passing these extra arguments may simplify log analysis a little bit

TommyMurphyTM1234 · 2024-04-21T21:25:37Z

I edited the Makefile to change this:

run.%:
	$(GDBSERVER_PY) \
		$(src_dir)/targets/RISC-V/$(word 2, $(subst ., ,$@)).py \
		$(word 3, $(subst ., ,$@)) \
		--isolate \
		--print-failures \
		$(if $(EXCLUDE_TESTS),--exclude-tests $(EXCLUDE_TESTS))

to this:

run.%:
	$(GDBSERVER_PY) \
		$(src_dir)/targets/RISC-V/$(word 2, $(subst ., ,$@)).py \
		$(word 3, $(subst ., ,$@)) \
		--isolate \
		--print-failures \
		$(if $(EXCLUDE_TESTS),--exclude-tests $(EXCLUDE_TESTS)) \
		--remotelogfile-enable --server_cmd "openocd -d3"

And then ran the smoke tests:

openocd -v
Open On-Chip Debugger 0.12.0+dev-03744-g3991492cc (2024-04-21-21:55)
Licensed under GNU GPL v2
For bug reports, read
	http://openocd.org/doc/doxygen/bugs.html

make

...

-------------------------------[ End of logs ]--------------------------------
Result: exception
Logfile: logs/20240421-222154-spike64_2-DownloadTest.log
Reproduce: ./gdbserver.py ./targets/RISC-V/spike64-2.py DownloadTest --hart 0
Time elapsed: 34.86s
::::::::::::::::::::::::::::[ ran 1 tests in 38s ]::::::::::::::::::::::::::::
1 tests returned exception
   DownloadTest > logs/20240421-222154-spike64_2-DownloadTest.log
make: *** [Makefile:19: run.spike64-2.DownloadTest] Error 1

Zipped 20240421-222154-spike64_2-DownloadTest.log: 20240421-222154-spike64_2-DownloadTest.log.zip

aap-sc · 2024-05-01T07:25:32Z

@TommyMurphyTM1234 I've finally managed to look at the 20240421-222154-spike64_2-DownloadTest.log.zip log in a greater detail.

Why the test fails.

I think I know the reason for this specific failure.

Let's take a look at gdb remote logs:

224255 c compare-sections
224256 w $qCRC:1212340000,63c#68                                                                                           
224257 r $C53cfcfd2#d3
224258 w $qCRC:1212340640,40000#9a                                                                                          
224259 r <Timeout: 5 seconds>
224260 w -
224261 r <Timeout: 5 seconds> 
224262 w -
224263 r <Timeout: 5 seconds>

So, when gdb requested to calculate crc, this operation resulted int timeout.

Looking at the OpenOCD sections of the logs we can see that:

Debug: 108730 9011 gdb_server.c:424 gdb_log_incoming_packet(): [riscv.cpu0] {1} received packet: qCRC:1212340640,40000
...
Debug: 209697 29895 image.c:1300 image_calculate_checksum(): Calculating checksum done; checksum=0x9492e72e          
Debug: 209698 29895 gdb_server.c:441 gdb_log_outgoing_packet(): [riscv.cpu0] {1} sending packet: $C9492e72e#4e

Indeed, it took 20 seconds (29895 - 9011) to calculate the sum.

This is why we have test failure.

The root cause

As for the root cause - this is because spike is a rather slow simulator. In addition to that halt mode in spike is implemented as a busy loop that constantly executes ROM code (at adress 0x1000 if I remember correctly). This means that whenever you have spike halted, the CPU usage by spike is still 100%.

How to fix

gdbserver.py has an additional --target-timeout argument. Increasing the value passed as a parameter value should help. Here is what we use in our CI at Syntacore:

--target-timeout 180

TommyMurphyTM1234 · 2024-05-01T08:11:08Z

Thanks a lot @aap-sc - as ever, you've provided excellent analysis/insight. I've been meaning to revisit this issue but just didn't get a chance yet. When I do I'll definitely take cognizance of your analysis/advice above.

Perhaps the test scripts need tweaking (e.g. to increase the relevant timeout(s)) as I would have expected the tests to run successfully out of the box barring "real" issues. But maybe it's difficult to ensure that this happens on all possible hosts. Mine is a VirtualBox VM running Zorin OS 17.1 Core on a 4th generation i5 host so obviously not the most powerful hardware available these days.

Anyway, I'll try to revisit this issue again soon. Thanks again. 👍

aap-sc · 2024-05-01T08:33:24Z

Perhaps the test scripts need tweaking (e.g. to increase the relevant timeout(s)) as I would have expected the tests to run successfully out of the box barring "real" issues.

Actually, you are right! If the --target-timeout is not specified via command line test script takes timeout from the board definitions (the *.py files from here, https://github.com/riscv-software-src/riscv-tests/tree/master/debug/targets/RISC-V).

Now, looking at the value of timeout_sec (the default remote timeout for the target), we can see that some targets like spike64-2.py and spike32-2-hwthread.py have this value WAY too low. I think it is reasonable to increase this value for all the targets. I'll create a MR.

RISC-V/spike-multi.py:    timeout_sec = 30
RISC-V/spike-multi.py:    server_timeout_sec = 120
RISC-V/spike32-2-hwthread.py:    timeout_sec = 5
RISC-V/spike32-2.py:    timeout_sec = 30
RISC-V/spike32.py:    timeout_sec = 30
RISC-V/spike64-2-hwthread.py:    timeout_sec = 20
RISC-V/spike64-2-rtos.py:    timeout_sec = 60
RISC-V/spike64-2.py:    timeout_sec = 5
RISC-V/spike64.py:    timeout_sec = 30
SiFive/Freedom/U500Sim.py:    timeout_sec = 6000

aap-sc · 2024-05-01T09:14:37Z

Should be addressed by riscv-software-src/riscv-tests#553

TommyMurphyTM1234 · 2024-05-01T13:52:27Z

Should be addressed by riscv-software-src/riscv-tests#553

Just to recap - my test host here is:

i5-4570R/1TB SSD/2 x 8 = 16GB DDR3 running Windows 10
Zorin OS 17.1 Core VirtualBox VM 10GB RAM/4 CPUs allocated

WIthout this PR I ran the "smoke test" twice and each time it failed:

Then I applied the changes in riscv-software-src/riscv-tests#553 and ran it again but it still failed. Seems to be a different failure to the timeout failures though?

20240501-142710-spike64-MemorySampleSingle.log

aap-sc · 2024-05-01T14:54:48Z

ran it again but it still failed

The set of failed tests is different, right?

Regarding this one:

20240501-142710-spike64-MemorySampleSingle.log

Yes, this seems to be another issue. In fact if you read my comment here: #1049 (comment) :

I also remember that some tests depend on host machine perfomance. For example I know
that MemorySampleSingle is affected, see call to:

    self.check_incrementing_samples(raw_samples, addr, tolerance=0x500000)

Internally at Syntacore we just patch-out the source code of this test for it to work on our CI machine.

So yes, this test is known to be affected by some other issue that needs to be weeded out.
Another known test is "Unavailable*"-something :) one that still sporadically fails in our environment.

TommyMurphyTM1234 · 2024-05-01T17:50:36Z

ran it again but it still failed

The set of failed tests is different, right?

Just to clarify - when the test run fails in these cases it fails on one test which terminates the tests altogether.
It's not a case of an unexpected failure or exception on a particular test reported after everything has completed but allowing subsequent tests to proceed.
It's some sort of fatal failure that causes the test run to terminate prematurely.

Regarding this one:

20240501-142710-spike64-MemorySampleSingle.log

Yes, this seems to be another issue. In fact if you read my comment here: #1049 (comment) :
I also remember that some tests depend on host machine perfomance. For example I know
that MemorySampleSingle is affected, see call to:

    self.check_incrementing_samples(raw_samples, addr, tolerance=0x500000)

Internally at Syntacore we just patch-out the source code of this test for it to work on our CI machine.
So yes, this test is known to be affected by some other issue that needs to be weeded out. Another known test is "Unavailable*"-something :) one that still sporadically fails in our environment.

Ah - sorry, I forgot that you had posted about this.

For what it's worth I did a 4th run after a reset of the board and this time all tests completed.

So...

[debug tests] increase remotetimeout for all spike-based targets riscv-software-src/riscv-tests#553 looks like it addresses the timeout failures
The MemorySampleSingle test failure is a known issue

TommyMurphyTM1234 · 2024-05-01T17:58:06Z

I did a 5th run and got another failure:

20240501-185209-spike64-CustomRegisterTest.log

Maybe this is the same class of failure as the aforementioned MemorySampleSingle test failure?

TommyMurphyTM1234 · 2024-05-01T20:52:59Z

Another run and another failure...

20240501-210945-spike64_2-RepeatReadTest.log

I need to go back through these failures to see if they are all of the same class - and maybe I should shift this issue/discussion to the riscv-tests repo assuming that these failures are not a result of any OpenOCD issue per se (if at all)?

aap-sc · 2024-05-01T20:58:59Z

@TommyMurphyTM1234 well,

As for MemorySampleSingle it would not hurt to report this issue to riscv-tests. There is a long-standing issue that needs some research
As for CustomRegisterTest.log / RepeatReadTest.log I'm planning to look into these failures (unless someone else won't do it sonner), though it may take some time.

TommyMurphyTM1234 · 2024-05-01T21:08:20Z

@TommyMurphyTM1234 well,

As for MemorySampleSingle it would not hurt to report this issue to riscv-tests. There is a long-standing issue that needs some research

Thanks - I will log that upstream in the riscv-tests repo so.

As for CustomRegisterTest.log / RepeatReadTest.log I'm planning to look into these failures (unless someone else won't do it sonner), though it may take some time.

Let me first (a) collect verbose OpenOCD/GDB remote protocol logs for such test failures and (b) see if I can have a look sooner. :-)

aap-sc · 2024-05-13T17:03:22Z

@TommyMurphyTM1234

RepeatReadTest looks like an issue with the test framework and may be related to Remove old warning check in RepeatReadTest riscv-software-src/riscv-tests#491 .

The issue there is with:

     values.append(int(v, 16))                                                                                                                              
 ValueError: invalid literal for int() with base 16: 'keep_alive()'

This makes me think that there is not enough sanitization of the command output.

As for CustomRegisterTest - this looks some other issue.

For now I suggest to:

I'm planning to try and fix MemorySampleSingle.
Wait till we have a clarification from @en-sc regarding Remove old warning check in RepeatReadTest riscv-software-src/riscv-tests#491
Wait till https://review.openocd.org/c/openocd/+/8227 is backported to riscv-openocd

then we should re-run these tests with verbose logs.

TommyMurphyTM1234 · 2024-05-13T18:49:39Z

Thanks @aap-sc.

Wait till https://review.openocd.org/c/openocd/+/8227 is backported to riscv-openocd

then we should re-run these tests with verbose logs.

Is there any point in me manually applying that patch and running the tests to see what happens?

aap-sc · 2024-05-14T05:37:29Z

@TommyMurphyTM1234

Is there any point in me manually applying that patch and running the tests to see what happens?

This looks like way too much hassle for my taste. We'll get this changes anyway in due time. Changes from upstream are merged fairly regularly these days, so it should not be too long.

TommyMurphyTM1234 · 2024-05-14T07:54:52Z

@TommyMurphyTM1234

Is there any point in me manually applying that patch and running the tests to see what happens?

This looks like way too much hassle for my taste. We'll get this changes anyway in due time. Changes from upstream are merged fairly regularly these days, so it should not be too long.

Ok, thanks. That's fine so.

BTW, running the tests repeatedly again I sometimes get other tests failing (and terminating the test run) and not just the three mentioned in the first post in this issue. I'm not sure if I should keep posting logs for such failures?

aap-sc · 2024-05-14T12:07:46Z

I suggest to wait till the situation with MemorySampleSingle is resolved.

I've manged to reproduce the problem in our lab environment with MemorySampleSingle and MemorySampleMixed . In addition, I plan to merge the fixed for some sporadic failures observed in other tests (UnavailableMultiTest for example).

If we keep constantly to update this ticket it may be hard to follow the status of the current situation.

TommyMurphyTM1234 · 2024-05-14T12:55:29Z

I suggest to wait till the situation with MemorySampleSingle is resolved.

Ok, thanks - I'll do that so.

I've manged to reproduce the problem in our lab environment with MemorySampleSingle and MemorySampleMixed . In addition, I plan to merge the fixed for some sporadic failures observed in other tests (UnavailableMultiTest for example).

That's great. 👍

If we keep constantly to update this ticket it may be hard to follow the status of the current situation.

I understand and agree.

Thanks again @aap-sc.

aap-sc · 2024-05-15T07:11:41Z

@TommyMurphyTM1234

I've manged to reproduce the problem in our lab environment with MemorySampleSingle and MemorySampleMixed . In addition, I plan to merge the fixed for some sporadic failures observed in other tests (UnavailableMultiTest for example).

The respected fixes are:

debug: fix sporadic failures of memory sampling tests riscv-software-src/riscv-tests#556
debug: workaround for sporadic failures of some tests due to unexpected data present in pexpect match riscv-software-src/riscv-tests#555

Once these fixes are applied I do not observe sporadic failures in our lab environment anymore (just FYI)

Now, I suggest to wait till these are merged in and till https://review.openocd.org/c/openocd/+/8227 is available in riscv-openocd (as discussed above).

aap-sc · 2024-06-05T18:23:38Z

@TommyMurphyTM1234 all the changes are merged to riscv-openocd (including https://review.openocd.org/c/openocd/+/8227). The number of sporadic failures should decrease now. We can try to re-run the testsuite on your machine to weed out remaining bugs. Please, let me know if you still have the will and desire to debug this.

TommyMurphyTM1234 · 2024-06-05T18:26:20Z

@TommyMurphyTM1234 all the changes are merged to riscv-openocd (including https://review.openocd.org/c/openocd/+/8227). The number of sporadic failures should decrease now. We can try to re-run the testsuite on your machine to weed out remaining bugs. Please, let me know if you still have the will and desire to debug this.

Thanks a lot @aap-sc. Yes, I'm happy and able to do further testing on this. I might get to it later today but, if not, then tomorrow.

TommyMurphyTM1234 · 2024-06-05T21:58:31Z

Thanks a lot @aap-sc. Yes, I'm happy and able to do further testing on this. I might get to it later today but, if not, then tomorrow.

@aap-sc - any idea about this? Maybe those "PRNG seed ..." related lines were supposed to be removed before the commit/PR was merged?

improvements to debug tests infrastructure to help with triaging process riscv-software-src/riscv-tests#531 (comment)

aap-sc · 2024-06-05T22:36:13Z

@TommyMurphyTM1234 no these messages are intentional. The intention is to report the selected seed to the user, so we could reproduce the run. This is important because even the compiled binaries sometimes depend on this seed. So it's quite confusing to debug issues and get different binaries every time.

TommyMurphyTM1234 · 2024-06-06T10:27:13Z

Thanks a lot @aap-sc. Yes, I'm happy and able to do further testing on this. I might get to it later today but, if not, then tomorrow.

@aap-sc - any idea about this? Maybe those "PRNG seed ..." related lines were supposed to be removed before the commit/PR was merged?

improvements to debug tests infrastructure to help with triaging process riscv-software-src/riscv-tests#531 (comment)

Debug: suppress PRNG seed ... log messages when gdbserver.py --list-tests <target> used riscv-software-src/riscv-tests#561

TommyMurphyTM1234 · 2024-06-06T20:00:31Z

I manually did a run of all tests against the four targets that the Makefile default rule executes and got these results:

./gdbserver.py ./targets/RISC-V/spike64.py --isolate --print-failures --remotelogfile-enable --server_cmd "openocd -d3" 2>&1 | tee test-spike64.log

Using $misa from hart definition: 0x8000000000141125
[CeaseStepiTest] Starting > logs/20240606-195706-spike64-CeaseStepiTest.log
[CeaseStepiTest] not_applicable in 0.00s
[CheckMisa] Starting > logs/20240606-195706-spike64-CheckMisa.log
[CheckMisa] pass in 1.49s
[CustomRegisterTest] Starting > logs/20240606-195708-spike64-CustomRegisterTest.log
[CustomRegisterTest] pass in 5.23s
[DebugBreakpoint] Starting > logs/20240606-195713-spike64-DebugBreakpoint.log
[DebugBreakpoint] pass in 5.46s
[DebugChangeString] Starting > logs/20240606-195718-spike64-DebugChangeString.log
[DebugChangeString] pass in 5.53s
[DebugCompareSections] Starting > logs/20240606-195724-spike64-DebugCompareSections.log
[DebugCompareSections] pass in 3.83s
[DebugExit] Starting > logs/20240606-195728-spike64-DebugExit.log
[DebugExit] pass in 4.08s
[DebugFunctionCall] Starting > logs/20240606-195732-spike64-DebugFunctionCall.log
[DebugFunctionCall] pass in 6.12s
[DebugSymbols] Starting > logs/20240606-195738-spike64-DebugSymbols.log
[DebugSymbols] pass in 4.53s
[DebugTurbostep] Starting > logs/20240606-195742-spike64-DebugTurbostep.log
[DebugTurbostep] pass in 7.13s
[DisconnectTest] Starting > logs/20240606-195749-spike64-DisconnectTest.log
[DisconnectTest] pass in 4.10s
[DownloadTest] Starting > logs/20240606-195754-spike64-DownloadTest.log
[DownloadTest] pass in 17.56s
[EbreakTest] Starting > logs/20240606-195811-spike64-EbreakTest.log
[EbreakTest] pass in 4.79s
[EtriggerTest] Starting > logs/20240606-195816-spike64-EtriggerTest.log
[EtriggerTest] pass in 4.76s
[FreeRtosTest] Starting > logs/20240606-195821-spike64-FreeRtosTest.log
[FreeRtosTest] pass in 11.37s
[Hwbp1] Starting > logs/20240606-195832-spike64-Hwbp1.log
[Hwbp1] pass in 5.44s
[Hwbp2] Starting > logs/20240606-195838-spike64-Hwbp2.log
[Hwbp2] pass in 6.13s
[HwbpManual] Starting > logs/20240606-195844-spike64-HwbpManual.log
[HwbpManual] pass in 7.37s
[IcountTest] Starting > logs/20240606-195851-spike64-IcountTest.log
[IcountTest] pass in 4.48s
[InfoTest] Starting > logs/20240606-195855-spike64-InfoTest.log
[InfoTest] pass in 1.58s
[InstantChangePc] Starting > logs/20240606-195857-spike64-InstantChangePc.log
[InstantChangePc] pass in 2.81s
[InstantHaltTest] Starting > logs/20240606-195900-spike64-InstantHaltTest.log
[InstantHaltTest] pass in 2.08s
[InterruptTest] Starting > logs/20240606-195902-spike64-InterruptTest.log
[InterruptTest] pass in 6.44s
[ItriggerTest] Starting > logs/20240606-195908-spike64-ItriggerTest.log
[ItriggerTest] pass in 4.18s
[JumpHbreak] Starting > logs/20240606-195913-spike64-JumpHbreak.log
[JumpHbreak] pass in 3.95s
[MemTest16] Starting > logs/20240606-195917-spike64-MemTest16.log
[MemTest16] pass in 1.94s
[MemTest32] Starting > logs/20240606-195918-spike64-MemTest32.log
[MemTest32] pass in 1.93s
[MemTest64] Starting > logs/20240606-195920-spike64-MemTest64.log
[MemTest64] pass in 1.94s
[MemTest8] Starting > logs/20240606-195922-spike64-MemTest8.log
[MemTest8] pass in 1.96s
[MemTestBlock0] Starting > logs/20240606-195924-spike64-MemTestBlock0.log
[MemTestBlock0] pass in 3.84s
[MemTestBlock1] Starting > logs/20240606-195928-spike64-MemTestBlock1.log
[MemTestBlock1] pass in 3.74s
[MemTestBlock2] Starting > logs/20240606-195932-spike64-MemTestBlock2.log
[MemTestBlock2] pass in 3.73s
[MemTestBlockReadInvalid] Starting > logs/20240606-195936-spike64-MemTestBlockReadInvalid.log
[MemTestBlockReadInvalid] not_applicable in 0.00s
[MemTestReadInvalid] Starting > logs/20240606-195936-spike64-MemTestReadInvalid.log
[MemTestReadInvalid] pass in 2.46s
[MemorySampleMixed] Starting > logs/20240606-195938-spike64-MemorySampleMixed.log
[MemorySampleMixed] pass in 10.67s
[MemorySampleSingle] Starting > logs/20240606-195949-spike64-MemorySampleSingle.log
[MemorySampleSingle] pass in 10.29s
[MulticoreRegTest] Starting > logs/20240606-195959-spike64-MulticoreRegTest.log
[MulticoreRegTest] not_applicable in 0.00s
[MulticoreRtosSwitchActiveHartTest] Starting > logs/20240606-195959-spike64-MulticoreRtosSwitchActiveHartTest.log
[MulticoreRtosSwitchActiveHartTest] not_applicable in 0.00s
[MulticoreRunAllHaltOne] Starting > logs/20240606-195959-spike64-MulticoreRunAllHaltOne.log
[MulticoreRunAllHaltOne] not_applicable in 0.00s
[PrivChange] Starting > logs/20240606-195959-spike64-PrivChange.log
[PrivChange] pass in 4.40s
[PrivRw] Starting > logs/20240606-200003-spike64-PrivRw.log
[PrivRw] pass in 5.39s
[ProgramHwWatchpoint] Starting > logs/20240606-200009-spike64-ProgramHwWatchpoint.log
[ProgramHwWatchpoint] pass in 7.00s
[ProgramSwWatchpoint] Starting > logs/20240606-200016-spike64-ProgramSwWatchpoint.log
[ProgramSwWatchpoint] pass in 15.07s
[Registers] Starting > logs/20240606-200031-spike64-Registers.log
[Registers] pass in 6.73s
[RepeatReadTest] Starting > logs/20240606-200038-spike64-RepeatReadTest.log
[RepeatReadTest] pass in 4.47s
[Semihosting] Starting > logs/20240606-200042-spike64-Semihosting.log
[Semihosting] pass in 5.69s
[SemihostingFileio] Starting > logs/20240606-200048-spike64-SemihostingFileio.log
[SemihostingFileio] pass in 5.66s
[SimpleF18Test] Starting > logs/20240606-200053-spike64-SimpleF18Test.log
[SimpleF18Test] pass in 3.75s
[SimpleNoExistTest] Starting > logs/20240606-200057-spike64-SimpleNoExistTest.log
[SimpleNoExistTest] pass in 1.48s
[SimpleS0Test] Starting > logs/20240606-200059-spike64-SimpleS0Test.log
[SimpleS0Test] pass in 3.37s
[SimpleS1Test] Starting > logs/20240606-200102-spike64-SimpleS1Test.log
[SimpleS1Test] pass in 3.35s
[SimpleT0Test] Starting > logs/20240606-200105-spike64-SimpleT0Test.log
[SimpleT0Test] pass in 3.33s
[SimpleT1Test] Starting > logs/20240606-200109-spike64-SimpleT1Test.log
[SimpleT1Test] pass in 3.35s
[SimpleV13Test] Starting > logs/20240606-200112-spike64-SimpleV13Test.log
[SimpleV13Test] pass in 2.19s
[SmpSimultaneousRunHalt] Starting > logs/20240606-200114-spike64-SmpSimultaneousRunHalt.log
[SmpSimultaneousRunHalt] not_applicable in 0.00s
[StepTest] Starting > logs/20240606-200114-spike64-StepTest.log
[StepTest] pass in 6.04s
[StepThread2Test] Starting > logs/20240606-200120-spike64-StepThread2Test.log
[StepThread2Test] not_applicable in 0.00s
[Sv32Test] Starting > logs/20240606-200120-spike64-Sv32Test.log
[Sv32Test] not_applicable in 0.00s
[Sv39Test] Starting > logs/20240606-200120-spike64-Sv39Test.log
[Sv39Test] pass in 5.42s
[Sv48Test] Starting > logs/20240606-200126-spike64-Sv48Test.log
[Sv48Test] pass in 5.28s
[TooManyHwbp] Starting > logs/20240606-200131-spike64-TooManyHwbp.log
[TooManyHwbp] pass in 8.20s
[TriggerDmode] Starting > logs/20240606-200139-spike64-TriggerDmode.log
[TriggerDmode] pass in 6.63s
[TriggerExecuteInstant] Starting > logs/20240606-200146-spike64-TriggerExecuteInstant.log
[TriggerExecuteInstant] pass in 3.69s
[TriggerLoadAddressInstant] Starting > logs/20240606-200150-spike64-TriggerLoadAddressInstant.log
[TriggerLoadAddressInstant] pass in 5.26s
[TriggerStoreAddressInstant] Starting > logs/20240606-200155-spike64-TriggerStoreAddressInstant.log
[TriggerStoreAddressInstant] pass in 4.53s
[UnavailableCycleTest] Starting > logs/20240606-200159-spike64-UnavailableCycleTest.log
[UnavailableCycleTest] pass in 3.55s
[UnavailableHaltedTest] Starting > logs/20240606-200203-spike64-UnavailableHaltedTest.log
[UnavailableHaltedTest] pass in 4.91s
[UnavailableMultiTest] Starting > logs/20240606-200208-spike64-UnavailableMultiTest.log
[UnavailableMultiTest] not_applicable in 0.00s
[UnavailableRunTest] Starting > logs/20240606-200208-spike64-UnavailableRunTest.log
[UnavailableRunTest] pass in 3.25s
[UserInterrupt] Starting > logs/20240606-200211-spike64-UserInterrupt.log
[UserInterrupt] pass in 6.97s
[VectorTest] Starting > logs/20240606-200218-spike64-VectorTest.log
[VectorTest] not_applicable in 0.00s
[WriteCsrs] Starting > logs/20240606-200218-spike64-WriteCsrs.log
[WriteCsrs] pass in 4.91s
[WriteGprs] Starting > logs/20240606-200223-spike64-WriteGprs.log
[WriteGprs] pass in 10.16s
:::::::::::::::::::::::::::[ ran 73 tests in 327s ]:::::::::::::::::::::::::::
10 tests returned not_applicable
63 tests returned pass

./gdbserver.py ./targets/RISC-V/spike64-2.py --isolate --print-failures --remotelogfile-enable --server_cmd "openocd -d3" 2>&1 | tee test-spike64-2.log

Using $misa from hart definition: 0x8000000000141129
Using $misa from hart definition: 0x8000000000141129
[CeaseStepiTest] Starting > logs/20240606-201340-spike64_2-CeaseStepiTest.log
[CeaseStepiTest] not_applicable in 0.00s
[CheckMisa] Starting > logs/20240606-201340-spike64_2-CheckMisa.log
[CheckMisa] pass in 2.36s
[CustomRegisterTest] Starting > logs/20240606-201342-spike64_2-CustomRegisterTest.log
[CustomRegisterTest] pass in 4.68s
[DebugBreakpoint] Starting > logs/20240606-201347-spike64_2-DebugBreakpoint.log
[DebugBreakpoint] pass in 5.07s
[DebugChangeString] Starting > logs/20240606-201352-spike64_2-DebugChangeString.log
[DebugChangeString] pass in 4.89s
[DebugCompareSections] Starting > logs/20240606-201357-spike64_2-DebugCompareSections.log
[DebugCompareSections] pass in 3.78s
[DebugExit] Starting > logs/20240606-201401-spike64_2-DebugExit.log
[DebugExit] pass in 4.09s
[DebugFunctionCall] Starting > logs/20240606-201405-spike64_2-DebugFunctionCall.log
[DebugFunctionCall] pass in 5.36s
[DebugSymbols] Starting > logs/20240606-201410-spike64_2-DebugSymbols.log
[DebugSymbols] pass in 4.34s
[DebugTurbostep] Starting > logs/20240606-201414-spike64_2-DebugTurbostep.log
[DebugTurbostep] pass in 6.86s
[DisconnectTest] Starting > logs/20240606-201421-spike64_2-DisconnectTest.log
[DisconnectTest] pass in 4.34s
[DownloadTest] Starting > logs/20240606-201426-spike64_2-DownloadTest.log
[DownloadTest] pass in 16.96s
[EbreakTest] Starting > logs/20240606-201443-spike64_2-EbreakTest.log
[EbreakTest] pass in 5.18s
[EtriggerTest] Starting > logs/20240606-201448-spike64_2-EtriggerTest.log
[EtriggerTest] pass in 4.59s
[FreeRtosTest] Starting > logs/20240606-201452-spike64_2-FreeRtosTest.log
[FreeRtosTest] not_applicable in 0.00s
[Hwbp1] Starting > logs/20240606-201452-spike64_2-Hwbp1.log
[Hwbp1] pass in 5.24s
[Hwbp2] Starting > logs/20240606-201458-spike64_2-Hwbp2.log
[Hwbp2] pass in 5.76s
[HwbpManual] Starting > logs/20240606-201503-spike64_2-HwbpManual.log
[HwbpManual] pass in 7.22s
[IcountTest] Starting > logs/20240606-201511-spike64_2-IcountTest.log
[IcountTest] pass in 5.19s
[InfoTest] Starting > logs/20240606-201516-spike64_2-InfoTest.log
[InfoTest] pass in 2.29s
[InstantChangePc] Starting > logs/20240606-201518-spike64_2-InstantChangePc.log
[InstantChangePc] pass in 3.38s
[InstantHaltTest] Starting > logs/20240606-201521-spike64_2-InstantHaltTest.log
[InstantHaltTest] pass in 2.82s
[InterruptTest] Starting > logs/20240606-201524-spike64_2-InterruptTest.log
[InterruptTest] pass in 7.10s
[ItriggerTest] Starting > logs/20240606-201531-spike64_2-ItriggerTest.log
[ItriggerTest] pass in 4.82s
[JumpHbreak] Starting > logs/20240606-201536-spike64_2-JumpHbreak.log
[JumpHbreak] pass in 4.37s
[MemTest16] Starting > logs/20240606-201541-spike64_2-MemTest16.log
[MemTest16] pass in 2.72s
[MemTest32] Starting > logs/20240606-201543-spike64_2-MemTest32.log
[MemTest32] pass in 2.72s
[MemTest64] Starting > logs/20240606-201546-spike64_2-MemTest64.log
[MemTest64] pass in 2.76s
[MemTest8] Starting > logs/20240606-201549-spike64_2-MemTest8.log
[MemTest8] pass in 2.88s
[MemTestBlock0] Starting > logs/20240606-201552-spike64_2-MemTestBlock0.log
[MemTestBlock0] pass in 4.54s
[MemTestBlock1] Starting > logs/20240606-201556-spike64_2-MemTestBlock1.log
[MemTestBlock1] pass in 4.29s
[MemTestBlock2] Starting > logs/20240606-201600-spike64_2-MemTestBlock2.log
[MemTestBlock2] pass in 4.29s
[MemTestBlockReadInvalid] Starting > logs/20240606-201605-spike64_2-MemTestBlockReadInvalid.log
[MemTestBlockReadInvalid] not_applicable in 0.00s
[MemTestReadInvalid] Starting > logs/20240606-201605-spike64_2-MemTestReadInvalid.log
[MemTestReadInvalid] pass in 3.01s
[MemorySampleMixed] Starting > logs/20240606-201608-spike64_2-MemorySampleMixed.log
[MemorySampleMixed] not_applicable in 0.00s
[MemorySampleSingle] Starting > logs/20240606-201608-spike64_2-MemorySampleSingle.log
[MemorySampleSingle] not_applicable in 0.00s
[MulticoreRegTest] Starting > logs/20240606-201608-spike64_2-MulticoreRegTest.log
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7efd78198670>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/gdb@44383-6_cokkbe.log'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7efd78198670>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7efd78198670>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7efd78198670>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/remote.gdb@38061-_d9lg_0d.log'
[MulticoreRegTest] pass in 20.04s
[MulticoreRtosSwitchActiveHartTest] Starting > logs/20240606-201628-spike64_2-MulticoreRtosSwitchActiveHartTest.log
[MulticoreRtosSwitchActiveHartTest] not_applicable in 3.44s
[MulticoreRunAllHaltOne] Starting > logs/20240606-201631-spike64_2-MulticoreRunAllHaltOne.log
[MulticoreRunAllHaltOne] pass in 4.97s
[PrivChange] Starting > logs/20240606-201636-spike64_2-PrivChange.log
[PrivChange] pass in 5.06s
[PrivRw] Starting > logs/20240606-201641-spike64_2-PrivRw.log
[PrivRw] pass in 5.65s
[ProgramHwWatchpoint] Starting > logs/20240606-201647-spike64_2-ProgramHwWatchpoint.log
[ProgramHwWatchpoint] pass in 7.25s
[ProgramSwWatchpoint] Starting > logs/20240606-201654-spike64_2-ProgramSwWatchpoint.log
[ProgramSwWatchpoint] pass in 10.54s
[Registers] Starting > logs/20240606-201705-spike64_2-Registers.log
[Registers] pass in 5.97s
[RepeatReadTest] Starting > logs/20240606-201711-spike64_2-RepeatReadTest.log
[RepeatReadTest] pass in 4.25s
[Semihosting] Starting > logs/20240606-201715-spike64_2-Semihosting.log
[Semihosting] pass in 5.55s
[SemihostingFileio] Starting > logs/20240606-201721-spike64_2-SemihostingFileio.log
[SemihostingFileio] not_applicable in 0.00s
[SimpleF18Test] Starting > logs/20240606-201721-spike64_2-SimpleF18Test.log
[SimpleF18Test] pass in 4.38s
[SimpleNoExistTest] Starting > logs/20240606-201725-spike64_2-SimpleNoExistTest.log
[SimpleNoExistTest] pass in 2.17s
[SimpleS0Test] Starting > logs/20240606-201727-spike64_2-SimpleS0Test.log
[SimpleS0Test] pass in 4.33s
[SimpleS1Test] Starting > logs/20240606-201731-spike64_2-SimpleS1Test.log
[SimpleS1Test] pass in 4.01s
[SimpleT0Test] Starting > logs/20240606-201735-spike64_2-SimpleT0Test.log
[SimpleT0Test] pass in 4.04s
[SimpleT1Test] Starting > logs/20240606-201739-spike64_2-SimpleT1Test.log
[SimpleT1Test] pass in 4.01s
[SimpleV13Test] Starting > logs/20240606-201743-spike64_2-SimpleV13Test.log
[SimpleV13Test] pass in 2.94s
[SmpSimultaneousRunHalt] Starting > logs/20240606-201746-spike64_2-SmpSimultaneousRunHalt.log
[SmpSimultaneousRunHalt] not_applicable in 3.32s
[StepTest] Starting > logs/20240606-201750-spike64_2-StepTest.log
[StepTest] pass in 6.53s
[StepThread2Test] Starting > logs/20240606-201756-spike64_2-StepThread2Test.log
[StepThread2Test] not_applicable in 2.27s
[Sv32Test] Starting > logs/20240606-201758-spike64_2-Sv32Test.log
[Sv32Test] not_applicable in 0.00s
[Sv39Test] Starting > logs/20240606-201758-spike64_2-Sv39Test.log
[Sv39Test] pass in 6.03s
[Sv48Test] Starting > logs/20240606-201805-spike64_2-Sv48Test.log
[Sv48Test] pass in 5.86s
[TooManyHwbp] Starting > logs/20240606-201810-spike64_2-TooManyHwbp.log
[TooManyHwbp] pass in 7.85s
[TriggerDmode] Starting > logs/20240606-201818-spike64_2-TriggerDmode.log
[TriggerDmode] pass in 7.10s
[TriggerExecuteInstant] Starting > logs/20240606-201825-spike64_2-TriggerExecuteInstant.log
[TriggerExecuteInstant] pass in 4.33s
[TriggerLoadAddressInstant] Starting > logs/20240606-201830-spike64_2-TriggerLoadAddressInstant.log
[TriggerLoadAddressInstant] pass in 5.60s
[TriggerStoreAddressInstant] Starting > logs/20240606-201835-spike64_2-TriggerStoreAddressInstant.log
[TriggerStoreAddressInstant] pass in 5.07s
[UnavailableCycleTest] Starting > logs/20240606-201840-spike64_2-UnavailableCycleTest.log
[UnavailableCycleTest] pass in 4.23s
[UnavailableHaltedTest] Starting > logs/20240606-201845-spike64_2-UnavailableHaltedTest.log
[UnavailableHaltedTest] pass in 5.45s
[UnavailableMultiTest] Starting > logs/20240606-201850-spike64_2-UnavailableMultiTest.log
[UnavailableMultiTest] pass in 184.64s
[UnavailableRunTest] Starting > logs/20240606-202155-spike64_2-UnavailableRunTest.log
[UnavailableRunTest] pass in 4.27s
[UserInterrupt] Starting > logs/20240606-202159-spike64_2-UserInterrupt.log
[UserInterrupt] pass in 6.84s
[VectorTest] Starting > logs/20240606-202206-spike64_2-VectorTest.log
[VectorTest] not_applicable in 0.00s
[WriteCsrs] Starting > logs/20240606-202206-spike64_2-WriteCsrs.log
[WriteCsrs] pass in 5.49s
[WriteGprs] Starting > logs/20240606-202211-spike64_2-WriteGprs.log
[WriteGprs] pass in 10.92s
:::::::::::::::::::::::::::[ ran 73 tests in 522s ]:::::::::::::::::::::::::::
11 tests returned not_applicable
62 tests returned pass

./gdbserver.py ./targets/RISC-V/spike32.py --isolate --print-failures --remotelogfile-enable --server_cmd "openocd -d3" 2>&1 | tee test-spike32.log

Using $misa from hart definition: 0x4034112d
[CeaseStepiTest] Starting > logs/20240606-200902-spike32-CeaseStepiTest.log
[CeaseStepiTest] not_applicable in 0.00s
[CheckMisa] Starting > logs/20240606-200902-spike32-CheckMisa.log
[CheckMisa] pass in 1.46s
[CustomRegisterTest] Starting > logs/20240606-200903-spike32-CustomRegisterTest.log
[CustomRegisterTest] pass in 5.23s
[DebugBreakpoint] Starting > logs/20240606-200909-spike32-DebugBreakpoint.log
[DebugBreakpoint] pass in 3.64s
[DebugChangeString] Starting > logs/20240606-200912-spike32-DebugChangeString.log
[DebugChangeString] pass in 3.44s
[DebugCompareSections] Starting > logs/20240606-200916-spike32-DebugCompareSections.log
[DebugCompareSections] pass in 2.30s
[DebugExit] Starting > logs/20240606-200918-spike32-DebugExit.log
[DebugExit] pass in 2.58s
[DebugFunctionCall] Starting > logs/20240606-200921-spike32-DebugFunctionCall.log
[DebugFunctionCall] pass in 3.92s
[DebugSymbols] Starting > logs/20240606-200925-spike32-DebugSymbols.log
[DebugSymbols] pass in 2.98s
[DebugTurbostep] Starting > logs/20240606-200928-spike32-DebugTurbostep.log
[DebugTurbostep] pass in 5.19s
[DisconnectTest] Starting > logs/20240606-200933-spike32-DisconnectTest.log
[DisconnectTest] pass in 3.96s
[DownloadTest] Starting > logs/20240606-200937-spike32-DownloadTest.log
[DownloadTest] pass in 6.82s
[EbreakTest] Starting > logs/20240606-200943-spike32-EbreakTest.log
[EbreakTest] pass in 3.76s
[EtriggerTest] Starting > logs/20240606-200947-spike32-EtriggerTest.log
[EtriggerTest] pass in 3.11s
[FreeRtosTest] Starting > logs/20240606-200950-spike32-FreeRtosTest.log
[FreeRtosTest] pass in 10.12s
[Hwbp1] Starting > logs/20240606-201000-spike32-Hwbp1.log
[Hwbp1] pass in 3.58s
[Hwbp2] Starting > logs/20240606-201004-spike32-Hwbp2.log
[Hwbp2] pass in 4.07s
[HwbpManual] Starting > logs/20240606-201008-spike32-HwbpManual.log
[HwbpManual] pass in 5.38s
[IcountTest] Starting > logs/20240606-201013-spike32-IcountTest.log
[IcountTest] pass in 3.38s
[InfoTest] Starting > logs/20240606-201017-spike32-InfoTest.log
[InfoTest] pass in 1.50s
[InstantChangePc] Starting > logs/20240606-201018-spike32-InstantChangePc.log
[InstantChangePc] pass in 2.55s
[InstantHaltTest] Starting > logs/20240606-201021-spike32-InstantHaltTest.log
[InstantHaltTest] pass in 2.02s
[InterruptTest] Starting > logs/20240606-201023-spike32-InterruptTest.log
[InterruptTest] pass in 5.59s
[ItriggerTest] Starting > logs/20240606-201029-spike32-ItriggerTest.log
[ItriggerTest] pass in 3.33s
[JumpHbreak] Starting > logs/20240606-201032-spike32-JumpHbreak.log
[JumpHbreak] pass in 3.15s
[MemTest16] Starting > logs/20240606-201035-spike32-MemTest16.log
[MemTest16] pass in 2.01s
[MemTest32] Starting > logs/20240606-201037-spike32-MemTest32.log
[MemTest32] pass in 1.91s
[MemTest64] Starting > logs/20240606-201039-spike32-MemTest64.log
[MemTest64] pass in 1.91s
[MemTest8] Starting > logs/20240606-201041-spike32-MemTest8.log
[MemTest8] pass in 1.92s
[MemTestBlock0] Starting > logs/20240606-201043-spike32-MemTestBlock0.log
[MemTestBlock0] pass in 3.44s
[MemTestBlock1] Starting > logs/20240606-201046-spike32-MemTestBlock1.log
[MemTestBlock1] pass in 3.44s
[MemTestBlock2] Starting > logs/20240606-201050-spike32-MemTestBlock2.log
[MemTestBlock2] pass in 3.43s
[MemTestBlockReadInvalid] Starting > logs/20240606-201053-spike32-MemTestBlockReadInvalid.log
[MemTestBlockReadInvalid] not_applicable in 0.00s
[MemTestReadInvalid] Starting > logs/20240606-201053-spike32-MemTestReadInvalid.log
[MemTestReadInvalid] pass in 2.31s
[MemorySampleMixed] Starting > logs/20240606-201055-spike32-MemorySampleMixed.log
[MemorySampleMixed] not_applicable in 0.00s
[MemorySampleSingle] Starting > logs/20240606-201055-spike32-MemorySampleSingle.log
[MemorySampleSingle] not_applicable in 0.00s
[MulticoreRegTest] Starting > logs/20240606-201055-spike32-MulticoreRegTest.log
[MulticoreRegTest] not_applicable in 0.00s
[MulticoreRtosSwitchActiveHartTest] Starting > logs/20240606-201055-spike32-MulticoreRtosSwitchActiveHartTest.log
[MulticoreRtosSwitchActiveHartTest] not_applicable in 0.00s
[MulticoreRunAllHaltOne] Starting > logs/20240606-201055-spike32-MulticoreRunAllHaltOne.log
[MulticoreRunAllHaltOne] not_applicable in 0.00s
[PrivChange] Starting > logs/20240606-201055-spike32-PrivChange.log
[PrivChange] pass in 3.62s
[PrivRw] Starting > logs/20240606-201059-spike32-PrivRw.log
[PrivRw] pass in 4.28s
[ProgramHwWatchpoint] Starting > logs/20240606-201103-spike32-ProgramHwWatchpoint.log
[ProgramHwWatchpoint] pass in 4.94s
[ProgramSwWatchpoint] Starting > logs/20240606-201108-spike32-ProgramSwWatchpoint.log
[ProgramSwWatchpoint] pass in 12.29s
[Registers] Starting > logs/20240606-201121-spike32-Registers.log
[Registers] pass in 5.17s
[RepeatReadTest] Starting > logs/20240606-201126-spike32-RepeatReadTest.log
[RepeatReadTest] pass in 2.79s
[Semihosting] Starting > logs/20240606-201129-spike32-Semihosting.log
[Semihosting] pass in 4.11s
[SemihostingFileio] Starting > logs/20240606-201133-spike32-SemihostingFileio.log
[SemihostingFileio] pass in 4.05s
[SimpleF18Test] Starting > logs/20240606-201137-spike32-SimpleF18Test.log
[SimpleF18Test] pass in 3.73s
[SimpleNoExistTest] Starting > logs/20240606-201140-spike32-SimpleNoExistTest.log
[SimpleNoExistTest] pass in 1.48s
[SimpleS0Test] Starting > logs/20240606-201142-spike32-SimpleS0Test.log
[SimpleS0Test] pass in 3.21s
[SimpleS1Test] Starting > logs/20240606-201145-spike32-SimpleS1Test.log
[SimpleS1Test] pass in 3.20s
[SimpleT0Test] Starting > logs/20240606-201148-spike32-SimpleT0Test.log
[SimpleT0Test] pass in 3.24s
[SimpleT1Test] Starting > logs/20240606-201152-spike32-SimpleT1Test.log
[SimpleT1Test] pass in 3.21s
[SimpleV13Test] Starting > logs/20240606-201155-spike32-SimpleV13Test.log
[SimpleV13Test] pass in 10.37s
[SmpSimultaneousRunHalt] Starting > logs/20240606-201205-spike32-SmpSimultaneousRunHalt.log
[SmpSimultaneousRunHalt] not_applicable in 0.00s
[StepTest] Starting > logs/20240606-201205-spike32-StepTest.log
[StepTest] pass in 5.10s
[StepThread2Test] Starting > logs/20240606-201210-spike32-StepThread2Test.log
[StepThread2Test] not_applicable in 0.00s
[Sv32Test] Starting > logs/20240606-201210-spike32-Sv32Test.log
[Sv32Test] pass in 4.61s
[Sv39Test] Starting > logs/20240606-201215-spike32-Sv39Test.log
[Sv39Test] not_applicable in 0.00s
[Sv48Test] Starting > logs/20240606-201215-spike32-Sv48Test.log
[Sv48Test] not_applicable in 0.00s
[TooManyHwbp] Starting > logs/20240606-201215-spike32-TooManyHwbp.log
[TooManyHwbp] pass in 6.53s
[TriggerDmode] Starting > logs/20240606-201221-spike32-TriggerDmode.log
[TriggerDmode] pass in 5.63s
[TriggerExecuteInstant] Starting > logs/20240606-201227-spike32-TriggerExecuteInstant.log
[TriggerExecuteInstant] pass in 2.78s
[TriggerLoadAddressInstant] Starting > logs/20240606-201230-spike32-TriggerLoadAddressInstant.log
[TriggerLoadAddressInstant] pass in 4.28s
[TriggerStoreAddressInstant] Starting > logs/20240606-201234-spike32-TriggerStoreAddressInstant.log
[TriggerStoreAddressInstant] pass in 3.56s
[UnavailableCycleTest] Starting > logs/20240606-201238-spike32-UnavailableCycleTest.log
[UnavailableCycleTest] pass in 2.84s
[UnavailableHaltedTest] Starting > logs/20240606-201240-spike32-UnavailableHaltedTest.log
[UnavailableHaltedTest] pass in 4.21s
[UnavailableMultiTest] Starting > logs/20240606-201245-spike32-UnavailableMultiTest.log
[UnavailableMultiTest] not_applicable in 0.00s
[UnavailableRunTest] Starting > logs/20240606-201245-spike32-UnavailableRunTest.log
[UnavailableRunTest] pass in 2.63s
[UserInterrupt] Starting > logs/20240606-201247-spike32-UserInterrupt.log
[UserInterrupt] pass in 5.64s
[VectorTest] Starting > logs/20240606-201253-spike32-VectorTest.log
[VectorTest] pass in 6.62s
[WriteCsrs] Starting > logs/20240606-201300-spike32-WriteCsrs.log
[WriteCsrs] pass in 4.03s
[WriteGprs] Starting > logs/20240606-201304-spike32-WriteGprs.log
[WriteGprs] pass in 9.65s
:::::::::::::::::::::::::::[ ran 73 tests in 251s ]:::::::::::::::::::::::::::
12 tests returned not_applicable
61 tests returned pass

./gdbserver.py ./targets/RISC-V/spike32-2.py --isolate --print-failures --remotelogfile-enable --server_cmd "openocd -d3" 2>&1 | tee test-spike32-2.log

Using $misa from hart definition: 0x40141125
Using $misa from hart definition: 0x40141125
[CeaseStepiTest] Starting > logs/20240606-204030-spike32_2-CeaseStepiTest.log
[CeaseStepiTest] not_applicable in 0.00s
[CheckMisa] Starting > logs/20240606-204030-spike32_2-CheckMisa.log
[CheckMisa] pass in 2.38s
[CustomRegisterTest] Starting > logs/20240606-204032-spike32_2-CustomRegisterTest.log
[CustomRegisterTest] pass in 4.37s
[DebugBreakpoint] Starting > logs/20240606-204037-spike32_2-DebugBreakpoint.log
[DebugBreakpoint] pass in 6.10s
[DebugChangeString] Starting > logs/20240606-204043-spike32_2-DebugChangeString.log
[DebugChangeString] pass in 5.88s
[DebugCompareSections] Starting > logs/20240606-204049-spike32_2-DebugCompareSections.log
[DebugCompareSections] pass in 5.19s
[DebugExit] Starting > logs/20240606-204054-spike32_2-DebugExit.log
[DebugExit] pass in 5.39s
[DebugFunctionCall] Starting > logs/20240606-204059-spike32_2-DebugFunctionCall.log
[DebugFunctionCall] pass in 6.46s
[DebugSymbols] Starting > logs/20240606-204106-spike32_2-DebugSymbols.log
[DebugSymbols] pass in 5.53s
[DebugTurbostep] Starting > logs/20240606-204111-spike32_2-DebugTurbostep.log
[DebugTurbostep] pass in 7.61s
[DisconnectTest] Starting > logs/20240606-204119-spike32_2-DisconnectTest.log
[DisconnectTest] pass in 4.12s
[DownloadTest] Starting > logs/20240606-204123-spike32_2-DownloadTest.log
[DownloadTest] pass in 33.36s
[EbreakTest] Starting > logs/20240606-204156-spike32_2-EbreakTest.log
[EbreakTest] pass in 5.63s
[EtriggerTest] Starting > logs/20240606-204202-spike32_2-EtriggerTest.log
[EtriggerTest] pass in 5.92s
[FreeRtosTest] Starting > logs/20240606-204208-spike32_2-FreeRtosTest.log
[FreeRtosTest] not_applicable in 0.00s
[Hwbp1] Starting > logs/20240606-204208-spike32_2-Hwbp1.log
[Hwbp1] pass in 6.10s
[Hwbp2] Starting > logs/20240606-204214-spike32_2-Hwbp2.log
[Hwbp2] pass in 6.56s
[HwbpManual] Starting > logs/20240606-204221-spike32_2-HwbpManual.log
[HwbpManual] pass in 7.87s
[IcountTest] Starting > logs/20240606-204228-spike32_2-IcountTest.log
[IcountTest] pass in 5.24s
[InfoTest] Starting > logs/20240606-204234-spike32_2-InfoTest.log
[InfoTest] pass in 2.44s
[InstantChangePc] Starting > logs/20240606-204236-spike32_2-InstantChangePc.log
[InstantChangePc] pass in 3.38s
[InstantHaltTest] Starting > logs/20240606-204239-spike32_2-InstantHaltTest.log
[InstantHaltTest] pass in 2.83s
[InterruptTest] Starting > logs/20240606-204242-spike32_2-InterruptTest.log
[InterruptTest] pass in 7.60s
[ItriggerTest] Starting > logs/20240606-204250-spike32_2-ItriggerTest.log
[ItriggerTest] pass in 5.31s
[JumpHbreak] Starting > logs/20240606-204255-spike32_2-JumpHbreak.log
[JumpHbreak] pass in 4.82s
[MemTest16] Starting > logs/20240606-204300-spike32_2-MemTest16.log
[MemTest16] pass in 2.72s
[MemTest32] Starting > logs/20240606-204303-spike32_2-MemTest32.log
[MemTest32] pass in 2.74s
[MemTest64] Starting > logs/20240606-204306-spike32_2-MemTest64.log
[MemTest64] pass in 2.85s
[MemTest8] Starting > logs/20240606-204308-spike32_2-MemTest8.log
[MemTest8] pass in 2.76s
[MemTestBlock0] Starting > logs/20240606-204311-spike32_2-MemTestBlock0.log
[MemTestBlock0] pass in 4.58s
[MemTestBlock1] Starting > logs/20240606-204316-spike32_2-MemTestBlock1.log
[MemTestBlock1] pass in 4.58s
[MemTestBlock2] Starting > logs/20240606-204320-spike32_2-MemTestBlock2.log
[MemTestBlock2] pass in 4.58s
[MemTestBlockReadInvalid] Starting > logs/20240606-204325-spike32_2-MemTestBlockReadInvalid.log
[MemTestBlockReadInvalid] not_applicable in 0.00s
[MemTestReadInvalid] Starting > logs/20240606-204325-spike32_2-MemTestReadInvalid.log
[MemTestReadInvalid] pass in 3.03s
[MemorySampleMixed] Starting > logs/20240606-204328-spike32_2-MemorySampleMixed.log
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7fbf77a50670>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7fbf77a50670>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7fbf77a50670>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7fbf77a50670>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
[MemorySampleMixed] pass in 11.70s
[MemorySampleSingle] Starting > logs/20240606-204340-spike32_2-MemorySampleSingle.log
[MemorySampleSingle] pass in 11.43s
[MulticoreRegTest] Starting > logs/20240606-204351-spike32_2-MulticoreRegTest.log
[MulticoreRegTest] pass in 20.14s
[MulticoreRtosSwitchActiveHartTest] Starting > logs/20240606-204411-spike32_2-MulticoreRtosSwitchActiveHartTest.log
[MulticoreRtosSwitchActiveHartTest] not_applicable in 4.43s
[MulticoreRunAllHaltOne] Starting > logs/20240606-204416-spike32_2-MulticoreRunAllHaltOne.log
[MulticoreRunAllHaltOne] pass in 5.91s
[PrivChange] Starting > logs/20240606-204421-spike32_2-PrivChange.log
[PrivChange] pass in 5.38s
[PrivRw] Starting > logs/20240606-204427-spike32_2-PrivRw.log
[PrivRw] pass in 6.24s
[ProgramHwWatchpoint] Starting > logs/20240606-204433-spike32_2-ProgramHwWatchpoint.log
[ProgramHwWatchpoint] pass in 6.61s
[ProgramSwWatchpoint] Starting > logs/20240606-204440-spike32_2-ProgramSwWatchpoint.log
[ProgramSwWatchpoint] pass in 9.05s
[Registers] Starting > logs/20240606-204449-spike32_2-Registers.log
[Registers] pass in 6.95s
[RepeatReadTest] Starting > logs/20240606-204456-spike32_2-RepeatReadTest.log
[RepeatReadTest] pass in 6.18s
[Semihosting] Starting > logs/20240606-204502-spike32_2-Semihosting.log
[Semihosting] pass in 6.30s
[SemihostingFileio] Starting > logs/20240606-204508-spike32_2-SemihostingFileio.log
[SemihostingFileio] not_applicable in 0.00s
[SimpleF18Test] Starting > logs/20240606-204508-spike32_2-SimpleF18Test.log
[SimpleF18Test] pass in 4.35s
[SimpleNoExistTest] Starting > logs/20240606-204513-spike32_2-SimpleNoExistTest.log
[SimpleNoExistTest] pass in 2.19s
[SimpleS0Test] Starting > logs/20240606-204515-spike32_2-SimpleS0Test.log
[SimpleS0Test] pass in 4.19s
[SimpleS1Test] Starting > logs/20240606-204519-spike32_2-SimpleS1Test.log
[SimpleS1Test] pass in 3.99s
[SimpleT0Test] Starting > logs/20240606-204523-spike32_2-SimpleT0Test.log
[SimpleT0Test] pass in 3.99s
[SimpleT1Test] Starting > logs/20240606-204527-spike32_2-SimpleT1Test.log
[SimpleT1Test] pass in 4.00s
[SimpleV13Test] Starting > logs/20240606-204531-spike32_2-SimpleV13Test.log
[SimpleV13Test] pass in 2.97s
[SmpSimultaneousRunHalt] Starting > logs/20240606-204534-spike32_2-SmpSimultaneousRunHalt.log
[SmpSimultaneousRunHalt] not_applicable in 3.80s
[StepTest] Starting > logs/20240606-204538-spike32_2-StepTest.log
[StepTest] pass in 6.71s
[StepThread2Test] Starting > logs/20240606-204544-spike32_2-StepThread2Test.log
[StepThread2Test] not_applicable in 2.32s
[Sv32Test] Starting > logs/20240606-204547-spike32_2-Sv32Test.log
[Sv32Test] pass in 7.20s
[Sv39Test] Starting > logs/20240606-204554-spike32_2-Sv39Test.log
[Sv39Test] not_applicable in 0.00s
[Sv48Test] Starting > logs/20240606-204554-spike32_2-Sv48Test.log
[Sv48Test] not_applicable in 0.00s
[TooManyHwbp] Starting > logs/20240606-204554-spike32_2-TooManyHwbp.log
[TooManyHwbp] pass in 8.86s
[TriggerDmode] Starting > logs/20240606-204603-spike32_2-TriggerDmode.log
[TriggerDmode] pass in 7.51s
[TriggerExecuteInstant] Starting > logs/20240606-204610-spike32_2-TriggerExecuteInstant.log
[TriggerExecuteInstant] pass in 4.69s
[TriggerLoadAddressInstant] Starting > logs/20240606-204615-spike32_2-TriggerLoadAddressInstant.log
[TriggerLoadAddressInstant] pass in 6.01s
[TriggerStoreAddressInstant] Starting > logs/20240606-204621-spike32_2-TriggerStoreAddressInstant.log
[TriggerStoreAddressInstant] pass in 5.39s
[UnavailableCycleTest] Starting > logs/20240606-204626-spike32_2-UnavailableCycleTest.log
[UnavailableCycleTest] pass in 4.66s
[UnavailableHaltedTest] Starting > logs/20240606-204631-spike32_2-UnavailableHaltedTest.log
[UnavailableHaltedTest] pass in 5.91s
[UnavailableMultiTest] Starting > logs/20240606-204637-spike32_2-UnavailableMultiTest.log
[UnavailableMultiTest] pass in 185.07s
[UnavailableRunTest] Starting > logs/20240606-204942-spike32_2-UnavailableRunTest.log
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7fbf77a50670>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7fbf77a50670>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7fbf77a50670>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7fbf77a50670>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7fbf77a50670>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7fbf77a50670>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/remote.gdb@44163-1_jboilp.log'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7fbf77a50670>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7fbf77a50670>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
[UnavailableRunTest] pass in 5.14s
[UserInterrupt] Starting > logs/20240606-204947-spike32_2-UserInterrupt.log
[UserInterrupt] pass in 8.00s
[VectorTest] Starting > logs/20240606-204955-spike32_2-VectorTest.log
[VectorTest] not_applicable in 0.00s
[WriteCsrs] Starting > logs/20240606-204955-spike32_2-WriteCsrs.log
[WriteCsrs] pass in 5.85s
[WriteGprs] Starting > logs/20240606-205001-spike32_2-WriteGprs.log
[WriteGprs] pass in 11.66s
:::::::::::::::::::::::::::[ ran 73 tests in 583s ]:::::::::::::::::::::::::::
10 tests returned not_applicable
63 tests returned pass

Note that previous tests were performed on a VirtualBox VM running Zorin OS Core 17.1 as a guest OS on a Windows 10 host whereas these were performed on WSL2/Ubuntu 22.04 on the same Windows 10 host. I'm not sure if the probably effectively lower spec resources of the former may have given different results (and more sporadic failures?) than the latter?

aap-sc · 2024-06-06T20:05:25Z

@TommyMurphyTM1234 so these ones do not show any signs of sporadic failues (for now). Do you have the capability to run this experiment on VirtualBox ?

TommyMurphyTM1234 · 2024-06-06T20:07:12Z

@TommyMurphyTM1234 so these ones do not show any signs of sporadic failues (for now). Do you have the capability to run this experiment on VirtualBox ?

Yes - I'll revert to my VirtualBox setup and run the tests again.

I'm not sure why there are a few Python exceptions in the logs, if they are sporadic or reproducible (I suspect the former), and if they are anything to be concerned about?

aap-sc · 2024-06-06T20:45:24Z

I'm not sure why there are a few Python exceptions in the logs, if they are sporadic or reproducible (I suspect the former), and if they are anything to be concerned about?

They are sporadic. They are somewhat reproducible. The reason for this warnings is described in greater detail here: riscv-software-src/riscv-tests#555 .

We should not be concerned about these warnings. If someone should be concerned - its Python developers (I mean literally the developers of CPython interpreter) who don't follow their own guidelines and allow exceptions to propagate from finalizers of TemporaryFile objects. One day I may file a bug against that - but right now I'm still hold the grudge against them (since I had to debug this).

TommyMurphyTM1234 · 2024-06-06T21:04:43Z

I'm not sure why there are a few Python exceptions in the logs, if they are sporadic or reproducible (I suspect the former), and if they are anything to be concerned about?

They are sporadic. They are somewhat reproducible. The reason for this warnings is described in greater detail here: riscv-software-src/riscv-tests#555 .

We should not be concerned about these warnings. If someone should be concerned - its Python developers (I mean literally the developers of CPython interpreter) who don't follow their own guidelines and allow exceptions to propagate from finalizers of TemporaryFile objects. One day I may file a bug against that - but right now I'm still hold the grudge against them (since I had to debug this).

@aap-sc - thanks a lot for that and for the link to the related/explanatory PR which you had previously tagged me on but which I must've missed. 👍

TommyMurphyTM1234 · 2024-06-08T13:35:17Z

Hi @aap-sc, I've reverted to my original VirtualBox/Zorin OS 17.1 setup and have run the tests (just once) there with the latest of everyting (riscv-openocd, riscv-gnu-toolchain bare-metal GCC and Spike, riscv-tests) and got these results:

./gdbserver.py ./targets/RISC-V/spike64.py --isolate --print-failures --remotelogfile-enable --server_cmd "openocd -d3" 2>&1 | tee test-spike64.log

Using $misa from hart definition: 0x8000000000141125
[CeaseStepiTest] Starting > logs/20240607-142956-spike64-CeaseStepiTest.log
[CeaseStepiTest] not_applicable in 0.00s
[CheckMisa] Starting > logs/20240607-142956-spike64-CheckMisa.log
[CheckMisa] pass in 2.88s
[CustomRegisterTest] Starting > logs/20240607-142959-spike64-CustomRegisterTest.log
[CustomRegisterTest] pass in 8.89s
[DebugBreakpoint] Starting > logs/20240607-143008-spike64-DebugBreakpoint.log
[DebugBreakpoint] pass in 47.33s
[DebugChangeString] Starting > logs/20240607-143055-spike64-DebugChangeString.log
[DebugChangeString] pass in 8.51s
[DebugCompareSections] Starting > logs/20240607-143104-spike64-DebugCompareSections.log
[DebugCompareSections] pass in 6.23s
[DebugExit] Starting > logs/20240607-143110-spike64-DebugExit.log
[DebugExit] pass in 6.27s
[DebugFunctionCall] Starting > logs/20240607-143116-spike64-DebugFunctionCall.log
[DebugFunctionCall] pass in 10.60s
[DebugSymbols] Starting > logs/20240607-143127-spike64-DebugSymbols.log
[DebugSymbols] pass in 6.69s
[DebugTurbostep] Starting > logs/20240607-143134-spike64-DebugTurbostep.log
[DebugTurbostep] pass in 10.71s
[DisconnectTest] Starting > logs/20240607-143144-spike64-DisconnectTest.log
[DisconnectTest] pass in 7.37s
[DownloadTest] Starting > logs/20240607-143152-spike64-DownloadTest.log
[DownloadTest] pass in 19.81s
[EbreakTest] Starting > logs/20240607-143212-spike64-EbreakTest.log
[EbreakTest] pass in 6.32s
[EtriggerTest] Starting > logs/20240607-143218-spike64-EtriggerTest.log
[EtriggerTest] pass in 7.28s
[FreeRtosTest] Starting > logs/20240607-143225-spike64-FreeRtosTest.log
[FreeRtosTest] pass in 15.59s
[Hwbp1] Starting > logs/20240607-143241-spike64-Hwbp1.log
[Hwbp1] pass in 57.63s
[Hwbp2] Starting > logs/20240607-143338-spike64-Hwbp2.log
[Hwbp2] pass in 9.20s
[HwbpManual] Starting > logs/20240607-143348-spike64-HwbpManual.log
[HwbpManual] pass in 27.58s
[IcountTest] Starting > logs/20240607-143415-spike64-IcountTest.log
[IcountTest] pass in 6.17s
[InfoTest] Starting > logs/20240607-143421-spike64-InfoTest.log
[InfoTest] pass in 2.02s
[InstantChangePc] Starting > logs/20240607-143423-spike64-InstantChangePc.log
[InstantChangePc] pass in 3.65s
[InstantHaltTest] Starting > logs/20240607-143427-spike64-InstantHaltTest.log
[InstantHaltTest] pass in 2.63s
[InterruptTest] Starting > logs/20240607-143430-spike64-InterruptTest.log
[InterruptTest] pass in 8.23s
[ItriggerTest] Starting > logs/20240607-143438-spike64-ItriggerTest.log
[ItriggerTest] pass in 29.75s
[JumpHbreak] Starting > logs/20240607-143508-spike64-JumpHbreak.log
[JumpHbreak] pass in 9.29s
[MemTest16] Starting > logs/20240607-143517-spike64-MemTest16.log
[MemTest16] pass in 2.32s
[MemTest32] Starting > logs/20240607-143519-spike64-MemTest32.log
[MemTest32] pass in 2.28s
[MemTest64] Starting > logs/20240607-143521-spike64-MemTest64.log
[MemTest64] pass in 2.40s
[MemTest8] Starting > logs/20240607-143524-spike64-MemTest8.log
[MemTest8] pass in 2.32s
[MemTestBlock0] Starting > logs/20240607-143526-spike64-MemTestBlock0.log
[MemTestBlock0] pass in 4.52s
[MemTestBlock1] Starting > logs/20240607-143531-spike64-MemTestBlock1.log
[MemTestBlock1] pass in 64.45s
[MemTestBlock2] Starting > logs/20240607-143635-spike64-MemTestBlock2.log
[MemTestBlock2] pass in 29.44s
[MemTestBlockReadInvalid] Starting > logs/20240607-143705-spike64-MemTestBlockReadInvalid.log
[MemTestBlockReadInvalid] not_applicable in 0.00s
[MemTestReadInvalid] Starting > logs/20240607-143705-spike64-MemTestReadInvalid.log
[MemTestReadInvalid] pass in 3.26s
[MemorySampleMixed] Starting > logs/20240607-143708-spike64-MemorySampleMixed.log
[MemorySampleMixed] pass in 12.98s
[MemorySampleSingle] Starting > logs/20240607-143721-spike64-MemorySampleSingle.log
[MemorySampleSingle] pass in 36.72s
[MulticoreRegTest] Starting > logs/20240607-143758-spike64-MulticoreRegTest.log
[MulticoreRegTest] not_applicable in 0.00s
[MulticoreRtosSwitchActiveHartTest] Starting > logs/20240607-143758-spike64-MulticoreRtosSwitchActiveHartTest.log
[MulticoreRtosSwitchActiveHartTest] not_applicable in 0.00s
[MulticoreRunAllHaltOne] Starting > logs/20240607-143758-spike64-MulticoreRunAllHaltOne.log
[MulticoreRunAllHaltOne] not_applicable in 0.00s
[PrivChange] Starting > logs/20240607-143758-spike64-PrivChange.log
[PrivChange] pass in 6.05s
[PrivRw] Starting > logs/20240607-143804-spike64-PrivRw.log
[PrivRw] pass in 6.68s
[ProgramHwWatchpoint] Starting > logs/20240607-143810-spike64-ProgramHwWatchpoint.log
[ProgramHwWatchpoint] pass in 11.35s
[ProgramSwWatchpoint] Starting > logs/20240607-143822-spike64-ProgramSwWatchpoint.log
[ProgramSwWatchpoint] pass in 47.74s
[Registers] Starting > logs/20240607-143909-spike64-Registers.log
[Registers] pass in 11.69s
[RepeatReadTest] Starting > logs/20240607-143921-spike64-RepeatReadTest.log
[RepeatReadTest] pass in 7.19s
[Semihosting] Starting > logs/20240607-143928-spike64-Semihosting.log
[Semihosting] pass in 9.90s
[SemihostingFileio] Starting > logs/20240607-143938-spike64-SemihostingFileio.log
[SemihostingFileio] pass in 8.80s
[SimpleF18Test] Starting > logs/20240607-143947-spike64-SimpleF18Test.log
[SimpleF18Test] pass in 4.82s
[SimpleNoExistTest] Starting > logs/20240607-143952-spike64-SimpleNoExistTest.log
[SimpleNoExistTest] pass in 1.91s
[SimpleS0Test] Starting > logs/20240607-143954-spike64-SimpleS0Test.log
[SimpleS0Test] pass in 4.12s
[SimpleS1Test] Starting > logs/20240607-143958-spike64-SimpleS1Test.log
[SimpleS1Test] pass in 4.10s
[SimpleT0Test] Starting > logs/20240607-144002-spike64-SimpleT0Test.log
[SimpleT0Test] pass in 4.12s
[SimpleT1Test] Starting > logs/20240607-144006-spike64-SimpleT1Test.log
[SimpleT1Test] pass in 4.18s
[SimpleV13Test] Starting > logs/20240607-144010-spike64-SimpleV13Test.log
[SimpleV13Test] pass in 2.73s
[SmpSimultaneousRunHalt] Starting > logs/20240607-144013-spike64-SmpSimultaneousRunHalt.log
[SmpSimultaneousRunHalt] not_applicable in 0.00s
[StepTest] Starting > logs/20240607-144013-spike64-StepTest.log
[StepTest] pass in 9.00s
[StepThread2Test] Starting > logs/20240607-144022-spike64-StepThread2Test.log
[StepThread2Test] not_applicable in 0.00s
[Sv32Test] Starting > logs/20240607-144022-spike64-Sv32Test.log
[Sv32Test] not_applicable in 0.00s
[Sv39Test] Starting > logs/20240607-144022-spike64-Sv39Test.log
[Sv39Test] pass in 7.54s
[Sv48Test] Starting > logs/20240607-144030-spike64-Sv48Test.log
[Sv48Test] pass in 7.38s
[TooManyHwbp] Starting > logs/20240607-144037-spike64-TooManyHwbp.log
[TooManyHwbp] pass in 11.13s
[TriggerDmode] Starting > logs/20240607-144048-spike64-TriggerDmode.log
[TriggerDmode] pass in 8.58s
[TriggerExecuteInstant] Starting > logs/20240607-144057-spike64-TriggerExecuteInstant.log
[TriggerExecuteInstant] pass in 6.12s
[TriggerLoadAddressInstant] Starting > logs/20240607-144103-spike64-TriggerLoadAddressInstant.log
[TriggerLoadAddressInstant] pass in 8.02s
[TriggerStoreAddressInstant] Starting > logs/20240607-144111-spike64-TriggerStoreAddressInstant.log
[TriggerStoreAddressInstant] pass in 61.33s
[UnavailableCycleTest] Starting > logs/20240607-144212-spike64-UnavailableCycleTest.log
[UnavailableCycleTest] pass in 4.92s
[UnavailableHaltedTest] Starting > logs/20240607-144217-spike64-UnavailableHaltedTest.log
[UnavailableHaltedTest] pass in 6.11s
[UnavailableMultiTest] Starting > logs/20240607-144223-spike64-UnavailableMultiTest.log
[UnavailableMultiTest] not_applicable in 0.00s
[UnavailableRunTest] Starting > logs/20240607-144223-spike64-UnavailableRunTest.log
[UnavailableRunTest] pass in 4.36s
[UserInterrupt] Starting > logs/20240607-144227-spike64-UserInterrupt.log
[UserInterrupt] pass in 74.53s
[VectorTest] Starting > logs/20240607-144342-spike64-VectorTest.log
[VectorTest] not_applicable in 0.00s
[WriteCsrs] Starting > logs/20240607-144342-spike64-WriteCsrs.log
[WriteCsrs] pass in 87.03s
[WriteGprs] Starting > logs/20240607-144509-spike64-WriteGprs.log
[WriteGprs] pass in 27.16s
:::::::::::::::::::::::::::[ ran 73 tests in 940s ]:::::::::::::::::::::::::::
10 tests returned not_applicable
63 tests returned pass

./gdbserver.py ./targets/RISC-V/spike64-2.py --isolate --print-failures --remotelogfile-enable --server_cmd "openocd -d3" 2>&1 | tee test-spike64-2.log

Using $misa from hart definition: 0x8000000000141129
Using $misa from hart definition: 0x8000000000141129
[CeaseStepiTest] Starting > logs/20240607-150049-spike64_2-CeaseStepiTest.log
[CeaseStepiTest] not_applicable in 0.00s
[CheckMisa] Starting > logs/20240607-150049-spike64_2-CheckMisa.log
[CheckMisa] pass in 3.07s
[CustomRegisterTest] Starting > logs/20240607-150052-spike64_2-CustomRegisterTest.log
[CustomRegisterTest] pass in 56.80s
[DebugBreakpoint] Starting > logs/20240607-150149-spike64_2-DebugBreakpoint.log
[DebugBreakpoint] pass in 61.81s
[DebugChangeString] Starting > logs/20240607-150251-spike64_2-DebugChangeString.log
[DebugChangeString] pass in 6.95s
[DebugCompareSections] Starting > logs/20240607-150258-spike64_2-DebugCompareSections.log
[DebugCompareSections] pass in 4.95s
[DebugExit] Starting > logs/20240607-150303-spike64_2-DebugExit.log
[DebugExit] pass in 5.18s
[DebugFunctionCall] Starting > logs/20240607-150308-spike64_2-DebugFunctionCall.log
[DebugFunctionCall] pass in 33.53s
[DebugSymbols] Starting > logs/20240607-150342-spike64_2-DebugSymbols.log
[DebugSymbols] pass in 47.57s
[DebugTurbostep] Starting > logs/20240607-150429-spike64_2-DebugTurbostep.log
[DebugTurbostep] pass in 114.84s
[DisconnectTest] Starting > logs/20240607-150624-spike64_2-DisconnectTest.log
[DisconnectTest] pass in 6.76s
[DownloadTest] Starting > logs/20240607-150631-spike64_2-DownloadTest.log
[DownloadTest] pass in 97.88s
[EbreakTest] Starting > logs/20240607-150809-spike64_2-EbreakTest.log
[EbreakTest] pass in 6.85s
[EtriggerTest] Starting > logs/20240607-150815-spike64_2-EtriggerTest.log
[EtriggerTest] pass in 64.42s
[FreeRtosTest] Starting > logs/20240607-150920-spike64_2-FreeRtosTest.log
[FreeRtosTest] not_applicable in 0.00s
[Hwbp1] Starting > logs/20240607-150920-spike64_2-Hwbp1.log
[Hwbp1] pass in 63.97s
[Hwbp2] Starting > logs/20240607-151024-spike64_2-Hwbp2.log
[Hwbp2] pass in 7.58s
[HwbpManual] Starting > logs/20240607-151031-spike64_2-HwbpManual.log
[HwbpManual] pass in 8.89s
[IcountTest] Starting > logs/20240607-151040-spike64_2-IcountTest.log
[IcountTest] pass in 6.17s
[InfoTest] Starting > logs/20240607-151046-spike64_2-InfoTest.log
[InfoTest] pass in 2.92s
[InstantChangePc] Starting > logs/20240607-151049-spike64_2-InstantChangePc.log
[InstantChangePc] pass in 15.22s
[InstantHaltTest] Starting > logs/20240607-151105-spike64_2-InstantHaltTest.log
[InstantHaltTest] pass in 3.44s
[InterruptTest] Starting > logs/20240607-151108-spike64_2-InterruptTest.log
[InterruptTest] pass in 32.73s
[ItriggerTest] Starting > logs/20240607-151141-spike64_2-ItriggerTest.log
[ItriggerTest] pass in 6.17s
[JumpHbreak] Starting > logs/20240607-151147-spike64_2-JumpHbreak.log
[JumpHbreak] pass in 5.80s
[MemTest16] Starting > logs/20240607-151153-spike64_2-MemTest16.log
[MemTest16] pass in 35.01s
[MemTest32] Starting > logs/20240607-151228-spike64_2-MemTest32.log
[MemTest32] pass in 46.96s
[MemTest64] Starting > logs/20240607-151315-spike64_2-MemTest64.log
[MemTest64] pass in 3.33s
[MemTest8] Starting > logs/20240607-151318-spike64_2-MemTest8.log
[MemTest8] pass in 3.31s
[MemTestBlock0] Starting > logs/20240607-151321-spike64_2-MemTestBlock0.log
[MemTestBlock0] pass in 35.91s
[MemTestBlock1] Starting > logs/20240607-151357-spike64_2-MemTestBlock1.log
[MemTestBlock1] pass in 5.24s
[MemTestBlock2] Starting > logs/20240607-151403-spike64_2-MemTestBlock2.log
[MemTestBlock2] pass in 5.23s
[MemTestBlockReadInvalid] Starting > logs/20240607-151408-spike64_2-MemTestBlockReadInvalid.log
[MemTestBlockReadInvalid] not_applicable in 0.00s
[MemTestReadInvalid] Starting > logs/20240607-151408-spike64_2-MemTestReadInvalid.log
[MemTestReadInvalid] pass in 27.05s
[MemorySampleMixed] Starting > logs/20240607-151435-spike64_2-MemorySampleMixed.log
[MemorySampleMixed] not_applicable in 0.00s
[MemorySampleSingle] Starting > logs/20240607-151435-spike64_2-MemorySampleSingle.log
[MemorySampleSingle] not_applicable in 0.00s
[MulticoreRegTest] Starting > logs/20240607-151435-spike64_2-MulticoreRegTest.log
[MulticoreRegTest] pass in 148.91s
[MulticoreRtosSwitchActiveHartTest] Starting > logs/20240607-151704-spike64_2-MulticoreRtosSwitchActiveHartTest.log
[MulticoreRtosSwitchActiveHartTest] not_applicable in 4.38s
[MulticoreRunAllHaltOne] Starting > logs/20240607-151708-spike64_2-MulticoreRunAllHaltOne.log
[MulticoreRunAllHaltOne] pass in 6.14s
[PrivChange] Starting > logs/20240607-151714-spike64_2-PrivChange.log
[PrivChange] pass in 72.39s
[PrivRw] Starting > logs/20240607-151827-spike64_2-PrivRw.log
[PrivRw] pass in 7.12s
[ProgramHwWatchpoint] Starting > logs/20240607-151834-spike64_2-ProgramHwWatchpoint.log
[ProgramHwWatchpoint] pass in 9.73s
[ProgramSwWatchpoint] Starting > logs/20240607-151843-spike64_2-ProgramSwWatchpoint.log
[ProgramSwWatchpoint] pass in 19.65s
[Registers] Starting > logs/20240607-151903-spike64_2-Registers.log
[Registers] pass in 9.12s
[RepeatReadTest] Starting > logs/20240607-151912-spike64_2-RepeatReadTest.log
[RepeatReadTest] pass in 5.73s
[Semihosting] Starting > logs/20240607-151918-spike64_2-Semihosting.log
[Semihosting] pass in 53.65s
[SemihostingFileio] Starting > logs/20240607-152012-spike64_2-SemihostingFileio.log
[SemihostingFileio] not_applicable in 0.00s
[SimpleF18Test] Starting > logs/20240607-152012-spike64_2-SimpleF18Test.log
[SimpleF18Test] pass in 5.35s
[SimpleNoExistTest] Starting > logs/20240607-152017-spike64_2-SimpleNoExistTest.log
[SimpleNoExistTest] pass in 21.96s
[SimpleS0Test] Starting > logs/20240607-152039-spike64_2-SimpleS0Test.log
[SimpleS0Test] pass in 4.89s
[SimpleS1Test] Starting > logs/20240607-152044-spike64_2-SimpleS1Test.log
[SimpleS1Test] pass in 4.88s
[SimpleT0Test] Starting > logs/20240607-152049-spike64_2-SimpleT0Test.log
[SimpleT0Test] pass in 67.85s
[SimpleT1Test] Starting > logs/20240607-152157-spike64_2-SimpleT1Test.log
[SimpleT1Test] pass in 46.93s
[SimpleV13Test] Starting > logs/20240607-152244-spike64_2-SimpleV13Test.log
[SimpleV13Test] pass in 3.64s
[SmpSimultaneousRunHalt] Starting > logs/20240607-152247-spike64_2-SmpSimultaneousRunHalt.log
[SmpSimultaneousRunHalt] not_applicable in 42.34s
[StepTest] Starting > logs/20240607-152329-spike64_2-StepTest.log
[StepTest] pass in 25.07s
[StepThread2Test] Starting > logs/20240607-152355-spike64_2-StepThread2Test.log
[StepThread2Test] not_applicable in 35.92s
[Sv32Test] Starting > logs/20240607-152430-spike64_2-Sv32Test.log
[Sv32Test] not_applicable in 0.00s
[Sv39Test] Starting > logs/20240607-152430-spike64_2-Sv39Test.log
[Sv39Test] pass in 7.62s
[Sv48Test] Starting > logs/20240607-152438-spike64_2-Sv48Test.log
[Sv48Test] pass in 7.59s
[TooManyHwbp] Starting > logs/20240607-152446-spike64_2-TooManyHwbp.log
[TooManyHwbp] pass in 9.79s
[TriggerDmode] Starting > logs/20240607-152455-spike64_2-TriggerDmode.log
[TriggerDmode] pass in 49.76s
[TriggerExecuteInstant] Starting > logs/20240607-152545-spike64_2-TriggerExecuteInstant.log
[TriggerExecuteInstant] pass in 5.35s
[TriggerLoadAddressInstant] Starting > logs/20240607-152551-spike64_2-TriggerLoadAddressInstant.log
[TriggerLoadAddressInstant] pass in 7.31s
[TriggerStoreAddressInstant] Starting > logs/20240607-152558-spike64_2-TriggerStoreAddressInstant.log
[TriggerStoreAddressInstant] pass in 6.41s
[UnavailableCycleTest] Starting > logs/20240607-152604-spike64_2-UnavailableCycleTest.log
[UnavailableCycleTest] pass in 5.19s
[UnavailableHaltedTest] Starting > logs/20240607-152609-spike64_2-UnavailableHaltedTest.log
[UnavailableHaltedTest] pass in 70.94s
[UnavailableMultiTest] Starting > logs/20240607-152720-spike64_2-UnavailableMultiTest.log
[UnavailableMultiTest] pass in 260.95s
[UnavailableRunTest] Starting > logs/20240607-153141-spike64_2-UnavailableRunTest.log
[UnavailableRunTest] pass in 4.87s
[UserInterrupt] Starting > logs/20240607-153146-spike64_2-UserInterrupt.log
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7f8662649630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7f8662649630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7f8662649630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7f8662649630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7f8662649630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7f8662649630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7f8662649630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7f8662649630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7f8662649630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7f8662649630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7f8662649630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x7f8662649630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
[UserInterrupt] pass in 48.14s
[VectorTest] Starting > logs/20240607-153234-spike64_2-VectorTest.log
[VectorTest] not_applicable in 0.00s
[WriteCsrs] Starting > logs/20240607-153234-spike64_2-WriteCsrs.log
[WriteCsrs] pass in 6.97s
[WriteGprs] Starting > logs/20240607-153241-spike64_2-WriteGprs.log
[WriteGprs] pass in 84.25s
::::::::::::::::::::::::::[ ran 73 tests in 1996s ]:::::::::::::::::::::::::::
11 tests returned not_applicable
62 tests returned pass

./gdbserver.py ./targets/RISC-V/spike32.py --isolate --print-failures --remotelogfile-enable --server_cmd "openocd -d3" 2>&1 | tee test-spike32.log

Using $misa from hart definition: 0x4034112d
[CeaseStepiTest] Starting > logs/20240607-181802-spike32-CeaseStepiTest.log
[CeaseStepiTest] not_applicable in 0.00s
[CheckMisa] Starting > logs/20240607-181802-spike32-CheckMisa.log
[CheckMisa] pass in 1.83s
[CustomRegisterTest] Starting > logs/20240607-181804-spike32-CustomRegisterTest.log
[CustomRegisterTest] pass in 39.96s
[DebugBreakpoint] Starting > logs/20240607-181844-spike32-DebugBreakpoint.log
[DebugBreakpoint] pass in 4.72s
[DebugChangeString] Starting > logs/20240607-181848-spike32-DebugChangeString.log
[DebugChangeString] pass in 4.89s
[DebugCompareSections] Starting > logs/20240607-181853-spike32-DebugCompareSections.log
[DebugCompareSections] pass in 39.32s
[DebugExit] Starting > logs/20240607-181933-spike32-DebugExit.log
[DebugExit] pass in 39.92s
[DebugFunctionCall] Starting > logs/20240607-182012-spike32-DebugFunctionCall.log
[DebugFunctionCall] pass in 51.13s
[DebugSymbols] Starting > logs/20240607-182104-spike32-DebugSymbols.log
[DebugSymbols] pass in 3.61s
[DebugTurbostep] Starting > logs/20240607-182107-spike32-DebugTurbostep.log
[DebugTurbostep] pass in 18.79s
[DisconnectTest] Starting > logs/20240607-182126-spike32-DisconnectTest.log
[DisconnectTest] pass in 8.18s
[DownloadTest] Starting > logs/20240607-182134-spike32-DownloadTest.log
[DownloadTest] pass in 8.27s
[EbreakTest] Starting > logs/20240607-182142-spike32-EbreakTest.log
[EbreakTest] pass in 5.37s
[EtriggerTest] Starting > logs/20240607-182148-spike32-EtriggerTest.log
[EtriggerTest] pass in 17.35s
[FreeRtosTest] Starting > logs/20240607-182205-spike32-FreeRtosTest.log
[FreeRtosTest] pass in 13.71s
[Hwbp1] Starting > logs/20240607-182219-spike32-Hwbp1.log
[Hwbp1] pass in 4.76s
[Hwbp2] Starting > logs/20240607-182224-spike32-Hwbp2.log
[Hwbp2] pass in 5.47s
[HwbpManual] Starting > logs/20240607-182229-spike32-HwbpManual.log
[HwbpManual] pass in 6.46s
[IcountTest] Starting > logs/20240607-182236-spike32-IcountTest.log
[IcountTest] pass in 4.24s
[InfoTest] Starting > logs/20240607-182240-spike32-InfoTest.log
[InfoTest] pass in 12.61s
[InstantChangePc] Starting > logs/20240607-182252-spike32-InstantChangePc.log
[InstantChangePc] pass in 3.23s
[InstantHaltTest] Starting > logs/20240607-182256-spike32-InstantHaltTest.log
[InstantHaltTest] pass in 32.67s
[InterruptTest] Starting > logs/20240607-182328-spike32-InterruptTest.log
[InterruptTest] pass in 6.47s
[ItriggerTest] Starting > logs/20240607-182335-spike32-ItriggerTest.log
[ItriggerTest] pass in 4.65s
[JumpHbreak] Starting > logs/20240607-182339-spike32-JumpHbreak.log
[JumpHbreak] pass in 3.64s
[MemTest16] Starting > logs/20240607-182343-spike32-MemTest16.log
[MemTest16] pass in 2.21s
[MemTest32] Starting > logs/20240607-182345-spike32-MemTest32.log
[MemTest32] pass in 2.24s
[MemTest64] Starting > logs/20240607-182348-spike32-MemTest64.log
[MemTest64] pass in 2.24s
[MemTest8] Starting > logs/20240607-182350-spike32-MemTest8.log
[MemTest8] pass in 2.21s
[MemTestBlock0] Starting > logs/20240607-182352-spike32-MemTestBlock0.log
[MemTestBlock0] pass in 4.01s
[MemTestBlock1] Starting > logs/20240607-182356-spike32-MemTestBlock1.log
[MemTestBlock1] pass in 4.01s
[MemTestBlock2] Starting > logs/20240607-182400-spike32-MemTestBlock2.log
[MemTestBlock2] pass in 3.95s
[MemTestBlockReadInvalid] Starting > logs/20240607-182404-spike32-MemTestBlockReadInvalid.log
[MemTestBlockReadInvalid] not_applicable in 0.00s
[MemTestReadInvalid] Starting > logs/20240607-182404-spike32-MemTestReadInvalid.log
[MemTestReadInvalid] pass in 2.90s
[MemorySampleMixed] Starting > logs/20240607-182407-spike32-MemorySampleMixed.log
[MemorySampleMixed] not_applicable in 0.00s
[MemorySampleSingle] Starting > logs/20240607-182407-spike32-MemorySampleSingle.log
[MemorySampleSingle] not_applicable in 0.00s
[MulticoreRegTest] Starting > logs/20240607-182407-spike32-MulticoreRegTest.log
[MulticoreRegTest] not_applicable in 0.00s
[MulticoreRtosSwitchActiveHartTest] Starting > logs/20240607-182407-spike32-MulticoreRtosSwitchActiveHartTest.log
[MulticoreRtosSwitchActiveHartTest] not_applicable in 0.00s
[MulticoreRunAllHaltOne] Starting > logs/20240607-182407-spike32-MulticoreRunAllHaltOne.log
[MulticoreRunAllHaltOne] not_applicable in 0.00s
[PrivChange] Starting > logs/20240607-182407-spike32-PrivChange.log
[PrivChange] pass in 26.72s
[PrivRw] Starting > logs/20240607-182434-spike32-PrivRw.log
[PrivRw] pass in 5.02s
[ProgramHwWatchpoint] Starting > logs/20240607-182439-spike32-ProgramHwWatchpoint.log
[ProgramHwWatchpoint] pass in 7.82s
[ProgramSwWatchpoint] Starting > logs/20240607-182446-spike32-ProgramSwWatchpoint.log
[ProgramSwWatchpoint] pass in 15.31s
[Registers] Starting > logs/20240607-182502-spike32-Registers.log
[Registers] pass in 9.50s
[RepeatReadTest] Starting > logs/20240607-182511-spike32-RepeatReadTest.log
[RepeatReadTest] pass in 3.55s
[Semihosting] Starting > logs/20240607-182515-spike32-Semihosting.log
[Semihosting] pass in 5.50s
[SemihostingFileio] Starting > logs/20240607-182520-spike32-SemihostingFileio.log
[SemihostingFileio] pass in 5.44s
[SimpleF18Test] Starting > logs/20240607-182526-spike32-SimpleF18Test.log
[SimpleF18Test] pass in 76.54s
[SimpleNoExistTest] Starting > logs/20240607-182642-spike32-SimpleNoExistTest.log
[SimpleNoExistTest] pass in 1.76s
[SimpleS0Test] Starting > logs/20240607-182644-spike32-SimpleS0Test.log
[SimpleS0Test] pass in 60.15s
[SimpleS1Test] Starting > logs/20240607-182744-spike32-SimpleS1Test.log
[SimpleS1Test] pass in 3.76s
[SimpleT0Test] Starting > logs/20240607-182748-spike32-SimpleT0Test.log
[SimpleT0Test] pass in 3.68s
[SimpleT1Test] Starting > logs/20240607-182752-spike32-SimpleT1Test.log
[SimpleT1Test] pass in 53.53s
[SimpleV13Test] Starting > logs/20240607-182845-spike32-SimpleV13Test.log
[SimpleV13Test] pass in 12.63s
[SmpSimultaneousRunHalt] Starting > logs/20240607-182858-spike32-SmpSimultaneousRunHalt.log
[SmpSimultaneousRunHalt] not_applicable in 0.00s
[StepTest] Starting > logs/20240607-182858-spike32-StepTest.log
[StepTest] pass in 81.18s
[StepThread2Test] Starting > logs/20240607-183019-spike32-StepThread2Test.log
[StepThread2Test] not_applicable in 0.00s
[Sv32Test] Starting > logs/20240607-183019-spike32-Sv32Test.log
[Sv32Test] pass in 5.62s
[Sv39Test] Starting > logs/20240607-183025-spike32-Sv39Test.log
[Sv39Test] not_applicable in 0.00s
[Sv48Test] Starting > logs/20240607-183025-spike32-Sv48Test.log
[Sv48Test] not_applicable in 0.00s
[TooManyHwbp] Starting > logs/20240607-183025-spike32-TooManyHwbp.log
[TooManyHwbp] pass in 7.56s
[TriggerDmode] Starting > logs/20240607-183032-spike32-TriggerDmode.log
[TriggerDmode] pass in 6.76s
[TriggerExecuteInstant] Starting > logs/20240607-183039-spike32-TriggerExecuteInstant.log
[TriggerExecuteInstant] pass in 4.05s
[TriggerLoadAddressInstant] Starting > logs/20240607-183043-spike32-TriggerLoadAddressInstant.log
[TriggerLoadAddressInstant] pass in 5.11s
[TriggerStoreAddressInstant] Starting > logs/20240607-183048-spike32-TriggerStoreAddressInstant.log
[TriggerStoreAddressInstant] pass in 4.28s
[UnavailableCycleTest] Starting > logs/20240607-183052-spike32-UnavailableCycleTest.log
[UnavailableCycleTest] pass in 3.45s
[UnavailableHaltedTest] Starting > logs/20240607-183056-spike32-UnavailableHaltedTest.log
[UnavailableHaltedTest] pass in 4.81s
[UnavailableMultiTest] Starting > logs/20240607-183101-spike32-UnavailableMultiTest.log
[UnavailableMultiTest] not_applicable in 0.00s
[UnavailableRunTest] Starting > logs/20240607-183101-spike32-UnavailableRunTest.log
[UnavailableRunTest] pass in 3.06s
[UserInterrupt] Starting > logs/20240607-183104-spike32-UserInterrupt.log
[UserInterrupt] pass in 6.13s
[VectorTest] Starting > logs/20240607-183110-spike32-VectorTest.log
[VectorTest] pass in 104.19s
[WriteCsrs] Starting > logs/20240607-183254-spike32-WriteCsrs.log
[WriteCsrs] pass in 4.85s
[WriteGprs] Starting > logs/20240607-183259-spike32-WriteGprs.log
[WriteGprs] pass in 11.07s
:::::::::::::::::::::::::::[ ran 73 tests in 908s ]:::::::::::::::::::::::::::
12 tests returned not_applicable
61 tests returned pass

./gdbserver.py ./targets/RISC-V/spike32-2.py --isolate --print-failures --remotelogfile-enable --server_cmd "openocd -d3" 2>&1 | tee test-spike32-2.log

Using $misa from hart definition: 0x40141125
Using $misa from hart definition: 0x40141125
[CeaseStepiTest] Starting > logs/20240607-190720-spike32_2-CeaseStepiTest.log
[CeaseStepiTest] not_applicable in 0.00s
[CheckMisa] Starting > logs/20240607-190720-spike32_2-CheckMisa.log
[CheckMisa] pass in 3.07s
[CustomRegisterTest] Starting > logs/20240607-190723-spike32_2-CustomRegisterTest.log
[CustomRegisterTest] pass in 49.88s
[DebugBreakpoint] Starting > logs/20240607-190813-spike32_2-DebugBreakpoint.log
[DebugBreakpoint] pass in 8.77s
[DebugChangeString] Starting > logs/20240607-190821-spike32_2-DebugChangeString.log
[DebugChangeString] pass in 8.62s
[DebugCompareSections] Starting > logs/20240607-190830-spike32_2-DebugCompareSections.log
[DebugCompareSections] pass in 22.59s
[DebugExit] Starting > logs/20240607-190852-spike32_2-DebugExit.log
[DebugExit] pass in 18.99s
[DebugFunctionCall] Starting > logs/20240607-190911-spike32_2-DebugFunctionCall.log
[DebugFunctionCall] pass in 77.96s
[DebugSymbols] Starting > logs/20240607-191029-spike32_2-DebugSymbols.log
[DebugSymbols] pass in 7.83s
[DebugTurbostep] Starting > logs/20240607-191037-spike32_2-DebugTurbostep.log
[DebugTurbostep] pass in 10.80s
[DisconnectTest] Starting > logs/20240607-191048-spike32_2-DisconnectTest.log
[DisconnectTest] pass in 6.71s
[DownloadTest] Starting > logs/20240607-191055-spike32_2-DownloadTest.log
[DownloadTest] pass in 46.88s
[EbreakTest] Starting > logs/20240607-191142-spike32_2-EbreakTest.log
[EbreakTest] pass in 7.73s
[EtriggerTest] Starting > logs/20240607-191149-spike32_2-EtriggerTest.log
[EtriggerTest] pass in 8.87s
[FreeRtosTest] Starting > logs/20240607-191158-spike32_2-FreeRtosTest.log
[FreeRtosTest] not_applicable in 0.00s
[Hwbp1] Starting > logs/20240607-191158-spike32_2-Hwbp1.log
[Hwbp1] pass in 8.90s
[Hwbp2] Starting > logs/20240607-191207-spike32_2-Hwbp2.log
[Hwbp2] pass in 9.78s
[HwbpManual] Starting > logs/20240607-191217-spike32_2-HwbpManual.log
[HwbpManual] pass in 11.21s
[IcountTest] Starting > logs/20240607-191228-spike32_2-IcountTest.log
[IcountTest] pass in 6.95s
[InfoTest] Starting > logs/20240607-191235-spike32_2-InfoTest.log
[InfoTest] pass in 2.89s
[InstantChangePc] Starting > logs/20240607-191238-spike32_2-InstantChangePc.log
[InstantChangePc] pass in 4.29s
[InstantHaltTest] Starting > logs/20240607-191242-spike32_2-InstantHaltTest.log
[InstantHaltTest] pass in 39.04s
[InterruptTest] Starting > logs/20240607-191321-spike32_2-InterruptTest.log
[InterruptTest] pass in 9.26s
[ItriggerTest] Starting > logs/20240607-191331-spike32_2-ItriggerTest.log
[ItriggerTest] pass in 7.59s
[JumpHbreak] Starting > logs/20240607-191338-spike32_2-JumpHbreak.log
[JumpHbreak] pass in 18.81s
[MemTest16] Starting > logs/20240607-191357-spike32_2-MemTest16.log
[MemTest16] pass in 33.33s
[MemTest32] Starting > logs/20240607-191430-spike32_2-MemTest32.log
[MemTest32] pass in 3.35s
[MemTest64] Starting > logs/20240607-191434-spike32_2-MemTest64.log
[MemTest64] pass in 35.59s
[MemTest8] Starting > logs/20240607-191509-spike32_2-MemTest8.log
[MemTest8] pass in 22.96s
[MemTestBlock0] Starting > logs/20240607-191532-spike32_2-MemTestBlock0.log
[MemTestBlock0] pass in 73.99s
[MemTestBlock1] Starting > logs/20240607-191646-spike32_2-MemTestBlock1.log
[MemTestBlock1] pass in 5.86s
[MemTestBlock2] Starting > logs/20240607-191652-spike32_2-MemTestBlock2.log
[MemTestBlock2] pass in 6.04s
[MemTestBlockReadInvalid] Starting > logs/20240607-191658-spike32_2-MemTestBlockReadInvalid.log
[MemTestBlockReadInvalid] not_applicable in 0.00s
[MemTestReadInvalid] Starting > logs/20240607-191658-spike32_2-MemTestReadInvalid.log
[MemTestReadInvalid] pass in 3.71s
[MemorySampleMixed] Starting > logs/20240607-191702-spike32_2-MemorySampleMixed.log
[MemorySampleMixed] pass in 14.78s
[MemorySampleSingle] Starting > logs/20240607-191717-spike32_2-MemorySampleSingle.log
[MemorySampleSingle] pass in 14.86s
[MulticoreRegTest] Starting > logs/20240607-191731-spike32_2-MulticoreRegTest.log
[MulticoreRegTest] pass in 69.99s
[MulticoreRtosSwitchActiveHartTest] Starting > logs/20240607-191841-spike32_2-MulticoreRtosSwitchActiveHartTest.log
[MulticoreRtosSwitchActiveHartTest] not_applicable in 5.90s
[MulticoreRunAllHaltOne] Starting > logs/20240607-191847-spike32_2-MulticoreRunAllHaltOne.log
[MulticoreRunAllHaltOne] pass in 7.68s
[PrivChange] Starting > logs/20240607-191855-spike32_2-PrivChange.log
[PrivChange] pass in 7.21s
[PrivRw] Starting > logs/20240607-191902-spike32_2-PrivRw.log
[PrivRw] pass in 7.69s
[ProgramHwWatchpoint] Starting > logs/20240607-191910-spike32_2-ProgramHwWatchpoint.log
[ProgramHwWatchpoint] pass in 9.96s
[ProgramSwWatchpoint] Starting > logs/20240607-191920-spike32_2-ProgramSwWatchpoint.log
[ProgramSwWatchpoint] pass in 17.53s
[Registers] Starting > logs/20240607-191937-spike32_2-Registers.log
[Registers] pass in 10.60s
[RepeatReadTest] Starting > logs/20240607-191948-spike32_2-RepeatReadTest.log
[RepeatReadTest] pass in 9.08s
[Semihosting] Starting > logs/20240607-191957-spike32_2-Semihosting.log
[Semihosting] pass in 8.99s
[SemihostingFileio] Starting > logs/20240607-192006-spike32_2-SemihostingFileio.log
[SemihostingFileio] not_applicable in 0.00s
[SimpleF18Test] Starting > logs/20240607-192006-spike32_2-SimpleF18Test.log
[SimpleF18Test] pass in 42.95s
[SimpleNoExistTest] Starting > logs/20240607-192049-spike32_2-SimpleNoExistTest.log
[SimpleNoExistTest] pass in 21.99s
[SimpleS0Test] Starting > logs/20240607-192111-spike32_2-SimpleS0Test.log
[SimpleS0Test] pass in 60.45s
[SimpleS1Test] Starting > logs/20240607-192212-spike32_2-SimpleS1Test.log
[SimpleS1Test] pass in 4.94s
[SimpleT0Test] Starting > logs/20240607-192216-spike32_2-SimpleT0Test.log
[SimpleT0Test] pass in 4.87s
[SimpleT1Test] Starting > logs/20240607-192221-spike32_2-SimpleT1Test.log
[SimpleT1Test] pass in 4.99s
[SimpleV13Test] Starting > logs/20240607-192226-spike32_2-SimpleV13Test.log
[SimpleV13Test] pass in 13.22s
[SmpSimultaneousRunHalt] Starting > logs/20240607-192240-spike32_2-SmpSimultaneousRunHalt.log
[SmpSimultaneousRunHalt] not_applicable in 5.78s
[StepTest] Starting > logs/20240607-192245-spike32_2-StepTest.log
[StepTest] pass in 8.88s
[StepThread2Test] Starting > logs/20240607-192254-spike32_2-StepThread2Test.log
[StepThread2Test] not_applicable in 2.99s
[Sv32Test] Starting > logs/20240607-192257-spike32_2-Sv32Test.log
[Sv32Test] pass in 8.89s
[Sv39Test] Starting > logs/20240607-192306-spike32_2-Sv39Test.log
[Sv39Test] not_applicable in 0.00s
[Sv48Test] Starting > logs/20240607-192306-spike32_2-Sv48Test.log
[Sv48Test] not_applicable in 0.00s
[TooManyHwbp] Starting > logs/20240607-192306-spike32_2-TooManyHwbp.log
[TooManyHwbp] pass in 11.73s
[TriggerDmode] Starting > logs/20240607-192318-spike32_2-TriggerDmode.log
[TriggerDmode] pass in 9.24s
[TriggerExecuteInstant] Starting > logs/20240607-192327-spike32_2-TriggerExecuteInstant.log
[TriggerExecuteInstant] pass in 6.30s
[TriggerLoadAddressInstant] Starting > logs/20240607-192333-spike32_2-TriggerLoadAddressInstant.log
[TriggerLoadAddressInstant] pass in 8.02s
[TriggerStoreAddressInstant] Starting > logs/20240607-192341-spike32_2-TriggerStoreAddressInstant.log
[TriggerStoreAddressInstant] pass in 7.07s
[UnavailableCycleTest] Starting > logs/20240607-192348-spike32_2-UnavailableCycleTest.log
[UnavailableCycleTest] pass in 5.96s
[UnavailableHaltedTest] Starting > logs/20240607-192354-spike32_2-UnavailableHaltedTest.log
[UnavailableHaltedTest] pass in 7.41s
[UnavailableMultiTest] Starting > logs/20240607-192402-spike32_2-UnavailableMultiTest.log
[UnavailableMultiTest] pass in 244.35s
[UnavailableRunTest] Starting > logs/20240607-192806-spike32_2-UnavailableRunTest.log
[UnavailableRunTest] pass in 23.62s
[UserInterrupt] Starting > logs/20240607-192830-spike32_2-UserInterrupt.log
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x73dbfd94d630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x73dbfd94d630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x73dbfd94d630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x73dbfd94d630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x73dbfd94d630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x73dbfd94d630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x73dbfd94d630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x73dbfd94d630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x73dbfd94d630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x73dbfd94d630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x73dbfd94d630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
Exception ignored in: <function _TemporaryFileCloser.__del__ at 0x73dbfd94d630>
Traceback (most recent call last):
  File "/usr/lib/python3.10/tempfile.py", line 589, in __del__
    self.close()
  File "/usr/lib/python3.10/tempfile.py", line 585, in close
    unlink(self.name)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/[email protected]'
[UserInterrupt] pass in 37.23s
[VectorTest] Starting > logs/20240607-192907-spike32_2-VectorTest.log
[VectorTest] not_applicable in 0.00s
[WriteCsrs] Starting > logs/20240607-192907-spike32_2-WriteCsrs.log
[WriteCsrs] pass in 7.58s
[WriteGprs] Starting > logs/20240607-192915-spike32_2-WriteGprs.log
[WriteGprs] pass in 13.06s
::::::::::::::::::::::::::[ ran 73 tests in 1328s ]:::::::::::::::::::::::::::
10 tests returned not_applicable
63 tests returned pass

I will run them a few more times just to see if there are any sporadic failures.

TommyMurphyTM1234 · 2024-06-08T15:21:13Z

Second run and one failure this time:

./gdbserver.py ./targets/RISC-V/spike32-2.py --isolate --print-failures --remotelogfile-enable --server_cmd "openocd -d3" 2>&1 | tee test-spike32-2.log

...

::::::::::::::::::::::::::[ ran 73 tests in 1933s ]:::::::::::::::::::::::::::
10 tests returned not_applicable
62 tests returned pass
1 tests returned fail
   MemorySampleMixed > logs/20240608-155212-spike32_2-MemorySampleMixed.log

20240608-155212-spike32_2-MemorySampleMixed.log: 20240608-155212-spike32_2-MemorySampleMixed.log

aap-sc · 2024-06-08T17:45:15Z

Regarding the MemorySampleMixed. I see the issue. I'll dig to find the root cause. Hopefully it won't take long (no promises, though).

@TommyMurphyTM1234 if you don't mind - can I ask you to run these 10-20 times more and report if there are more failures?

TommyMurphyTM1234 · 2024-06-08T22:29:01Z

Regarding the MemorySampleMixed. I see the issue. I'll dig to find the root cause. Hopefully it won't take long (no promises, though).

Great - thanks @aap-sc.

@TommyMurphyTM1234 if you don't mind - can I ask you to run these 10-20 times more and report if there are more failures?

Will do - I'll do 10 anyway as it take quite a while to run each set of four target tests on the virtual machine.

TommyMurphyTM1234 · 2024-06-09T19:21:53Z

Here are the results of 10 further runs:

No failures/exceptions
20240608-195858-spike64-MemorySampleSingle.log
No failures/exceptions
20240608-232734-spike64-HwbpManual.log
No failures/exceptions
20240609-124049-spike64-WriteGprs.log
20240609-142430-spike64-RepeatReadTest.log
20240609-153957-spike64-JumpHbreak.log and 20240609-162951-spike32_2-MemorySampleMixed.log
No failures/exceptions
No failures/exceptions

aap-sc · 2024-06-09T19:47:49Z

ghrrrr. That's way more failures than I expected :(

TommyMurphyTM1234 · 2024-06-09T20:59:34Z

I'll add further results here:

20240609-204109-spike64-TriggerExecuteInstant.log
No failures/exceptions
No failures/exceptions
20240610-181232-spike64-UnavailableRunTest.log
No failures/exceptions
20240611-121620-spike64-SimpleT1Test.log
No failures/exceptions
20240611-154731-spike32-RepeatReadTest.log
No failures/exceptions
20240611-202458-spike64-EbreakTest.log and 20240611-204748-spike64-UnavailableCycleTest.log

TommyMurphyTM1234 · 2024-06-11T21:03:35Z

That's the results of 20 runs of these tests - I won't do any more until requested.

aap-sc · 2024-06-11T21:12:45Z

That's the results of 20 runs of these tests - I won't do any more until requested.

@TommyMurphyTM1234 thanks a lot!

I hope it's not that big of a deal to run these... Sorry if it took more effort/time than one could expect :(.

It will take some time to fix. At least some of these failures are easy to understand (not necessary easy to fix, though). For example: RepeatReadTest tests fail because test infrastructure expects only output of the underlying monitor command to be present in "monitor " statement. However for whatever abysmall reason OpenOCD adds target warnings to the resulting output (missing keep-alive messages, for example). This results in "invalid literal for int" exceptions to cause test failure. There is no consensus on how to fix this (@en-sc and me have a disagreement at the moment) - hopefully, this should be resolved soon.

Other cases are more tricky and will requite more effort to debug.

TommyMurphyTM1234 · 2024-06-11T21:29:16Z

@TommyMurphyTM1234 thanks a lot!

I hope it's not that big of a deal to run these... Sorry if it took more effort/time than one could expect :(.

No problem. It was a bit tedious on the hardware that I had available for this but not a big deal - just slow! 🙂

It will take some time to fix. At least some of these failures are easy to understand (not necessary easy to fix, though). For example: RepeatReadTest tests fail because test infrastructure expects only output of the underlying monitor command to be present in "monitor " statement. However for whatever abysmall reason OpenOCD adds target warnings to the resulting output (missing keep-alive messages, for example). This results in "invalid literal for int" exceptions to cause test failure. There is no consensus on how to fix this (@en-sc and me have a disagreement at the moment) - hopefully, this should be resolved soon

That's interesting, thanks. Perhaps some changes to upstream OpenOCD functionality may be required in order to address some of these failures/exceptions?

Other cases are more tricky and will requite more effort to debug.

Ok, thanks.

aap-sc · 2024-06-11T21:39:18Z

Perhaps some changes to upstream OpenOCD functionality may be required in order to address some of these failures/exceptions?

yeah. I'm not sure why it was decided to send warnings along with the useful data for "monitor" commands sent by GDB.

TommyMurphyTM1234 · 2024-06-11T21:42:33Z

Perhaps some changes to upstream OpenOCD functionality may be required in order to address some of these failures/exceptions?

yeah. I'm not sure why it was decided to send warnings along with the useful data for "monitor" commands sent by GDB.

Could it be a stdout vs stderr mismatch issue perhaps? E.g. "regular" output should go to the former and warning/error output to the latter, maybe?

aap-sc · 2024-06-11T21:56:58Z

Could it be a stdout vs stderr mismatch issue perhaps? E.g. "regular" output should go to the former and warning/error output to the latter, maybe?

Kind of but not exactly. OpenOCD sends data (reply) to GDB via dedicated channel (socket/pipe/whatever) via GDB serial protocol. So the output will go to the same sink anyway. That being said - probably warnings should be sent as "asynchronous notifications" that gdb serial protocol should support. I'm not quite sure what OpenOCD does at the moment.

If it sends these warnings as a notification - we should have facilities to differentiate between these notifications and the actual command output on client side (that is GDB client). If not - this should be fixed. If these warnings are sent along with the actual output - this should be tackled too (in my opinion).

The above still requires an investigation - I'm not ready to make a definitive conclusion yet. I'll post a separate notification once I get a more substantial understanding of what is going on.

TommyMurphyTM1234 · 2024-06-12T09:08:58Z

Ah - sorry - I was thinking of the "console" stdout/stderr output from OpenOCD and forgot that, in this context, we're dealing with a socket/pipe connection between OpenOCD and GDB. Thanks for the info. If I can help at with more testing or even investigation let me know.

aap-sc mentioned this issue Apr 21, 2024

Debug test suite unexpected failures against SiFive HiFive1 board #1047

Closed

TommyMurphyTM1234 mentioned this issue May 1, 2024

[debug tests] increase remotetimeout for all spike-based targets riscv-software-src/riscv-tests#553

Merged

TommyMurphyTM1234 mentioned this issue May 3, 2024

Improve stability of riscv-tests for targets with low remotetimeout value #1065

Open

aap-sc mentioned this issue Jul 9, 2024

Align include guards with OpenOCD coding guidelines #1104

Merged

Random/sporadic failures running test suite interactively against Spike #1049

Random/sporadic failures running test suite interactively against Spike #1049

Comments

TommyMurphyTM1234 commented Apr 21, 2024

TommyMurphyTM1234 commented Apr 21, 2024 • edited Loading

aap-sc commented Apr 21, 2024 • edited Loading

TommyMurphyTM1234 commented Apr 21, 2024

aap-sc commented May 1, 2024 • edited Loading

Why the test fails.

The root cause

How to fix

TommyMurphyTM1234 commented May 1, 2024

aap-sc commented May 1, 2024 • edited Loading

aap-sc commented May 1, 2024

TommyMurphyTM1234 commented May 1, 2024 • edited Loading

aap-sc commented May 1, 2024 • edited Loading

TommyMurphyTM1234 commented May 1, 2024

TommyMurphyTM1234 commented May 1, 2024 • edited Loading

TommyMurphyTM1234 commented May 1, 2024 • edited Loading

aap-sc commented May 1, 2024

TommyMurphyTM1234 commented May 1, 2024

aap-sc commented May 13, 2024

TommyMurphyTM1234 commented May 13, 2024

aap-sc commented May 14, 2024

TommyMurphyTM1234 commented May 14, 2024

aap-sc commented May 14, 2024 • edited Loading

TommyMurphyTM1234 commented May 14, 2024

aap-sc commented May 15, 2024

aap-sc commented Jun 5, 2024 • edited Loading

TommyMurphyTM1234 commented Jun 5, 2024

TommyMurphyTM1234 commented Jun 5, 2024 • edited Loading

aap-sc commented Jun 5, 2024

TommyMurphyTM1234 commented Jun 6, 2024

TommyMurphyTM1234 commented Jun 6, 2024 • edited Loading

aap-sc commented Jun 6, 2024

TommyMurphyTM1234 commented Jun 6, 2024

aap-sc commented Jun 6, 2024 • edited Loading

TommyMurphyTM1234 commented Jun 6, 2024

TommyMurphyTM1234 commented Jun 8, 2024

TommyMurphyTM1234 commented Jun 8, 2024

aap-sc commented Jun 8, 2024 • edited Loading

TommyMurphyTM1234 commented Jun 8, 2024

TommyMurphyTM1234 commented Jun 9, 2024 • edited Loading

aap-sc commented Jun 9, 2024

TommyMurphyTM1234 commented Jun 9, 2024 • edited Loading

TommyMurphyTM1234 commented Jun 11, 2024 • edited Loading

aap-sc commented Jun 11, 2024

TommyMurphyTM1234 commented Jun 11, 2024

aap-sc commented Jun 11, 2024

TommyMurphyTM1234 commented Jun 11, 2024

aap-sc commented Jun 11, 2024 • edited Loading

TommyMurphyTM1234 commented Jun 12, 2024

TommyMurphyTM1234 commented Apr 21, 2024 •

edited

Loading

aap-sc commented Apr 21, 2024 •

edited

Loading

aap-sc commented May 1, 2024 •

edited

Loading

aap-sc commented May 1, 2024 •

edited

Loading

TommyMurphyTM1234 commented May 1, 2024 •

edited

Loading

aap-sc commented May 1, 2024 •

edited

Loading

TommyMurphyTM1234 commented May 1, 2024 •

edited

Loading

TommyMurphyTM1234 commented May 1, 2024 •

edited

Loading

aap-sc commented May 14, 2024 •

edited

Loading

aap-sc commented Jun 5, 2024 •

edited

Loading

TommyMurphyTM1234 commented Jun 5, 2024 •

edited

Loading

TommyMurphyTM1234 commented Jun 6, 2024 •

edited

Loading

aap-sc commented Jun 6, 2024 •

edited

Loading

aap-sc commented Jun 8, 2024 •

edited

Loading

TommyMurphyTM1234 commented Jun 9, 2024 •

edited

Loading

TommyMurphyTM1234 commented Jun 9, 2024 •

edited

Loading

TommyMurphyTM1234 commented Jun 11, 2024 •

edited

Loading

aap-sc commented Jun 11, 2024 •

edited

Loading