Request for Benchmarks and Tests

APL-related discussions - a stream of APL consciousness.
Not sure where to start a discussion ? Here's the place to be
Forum rules
This forum is for discussing APL-related issues. If you think that the subject is off-topic, then the Chat forum is probably a better place for your thoughts !

Request for Benchmarks and Tests

Postby Morten|Dyalog on Wed Feb 23, 2022 7:13 am

For use in future work on enhancing the performance and ensuring the correctness of Dyalog APL, we are looking for benchmarks and tests that we will be able to run alongside our own QA suites. For performance in particular, it is difficult for us to construct "synthetic" tests that are reliable indicators of how the interpreter will perform while running real applications.

We would VERY MUCH appreciate it if you are able to provide us with code extracts from real applications, which we could run as part of our overnight test suite, to keep track of performance and correctness as we enhance the interpreter.

We are interested in ALL tests that can be made available to us, even if they do not live up to the following "ideal" requirements (except for the first requirement below):

1) Be part of a real application (ideally something where performance matters to the users)
2) Not require the installation of additional software (databases, web servers, etc)
3) Not contain sensitive data that we need to keep confidential
4) Not run for more than 5-10 minutes
5) Include checks that verify the correctness of computed results (but pure speed tests are also very interesting)

Thanks in advance for anything that you can do to help!

/ Morten
User avatar
Morten|Dyalog
 
Posts: 451
Joined: Tue Sep 09, 2008 3:52 pm

Re: Request for Benchmarks and Tests

Postby Morten|Dyalog on Tue Mar 15, 2022 6:07 am

P.S. Does anyone have a copy of the famous "STSC Benchmarks" in any shape or form?
User avatar
Morten|Dyalog
 
Posts: 451
Joined: Tue Sep 09, 2008 3:52 pm


Return to APL Chat

Who is online

Users browsing this forum: No registered users and 1 guest