]> git.cworth.org Git - apitrace-tests/log
apitrace-tests
11 years agoglxsimple: Add a second frame drawing a solid color with GLSL.
Carl Worth [Mon, 13 Aug 2012 00:16:04 +0000 (17:16 -0700)]
glxsimple: Add a second frame drawing a solid color with GLSL.

This will allow us to test that we can trim out unused shaders.

11 years agoAdd the source of a very simple program using OpenGL through GLX.
Carl Worth [Mon, 13 Aug 2012 00:09:15 +0000 (17:09 -0700)]
Add the source of a very simple program using OpenGL through GLX.

We'll use this program to generate traces for use in the test suite,
(to exercise using "apitrace trim" to trim away unused textures,
shader programs, etc.).

There is a Makefile here, for convenience to any test writers wanting
to expand this program. Note that this Makefile us intentionally not
integrated with the cmake setup of the apitrace-tests project. That's
because it is not expected that this test program should be built or
run as a standard part of the test suite. Instead, useful trace files
generated from glxsimple will be directly committed to the
apitrace-tests repository.

11 years agocli: Use new --call-nos=no call to "apitrace dump-images" for consistent results
Carl Worth [Mon, 13 Aug 2012 00:00:38 +0000 (17:00 -0700)]
cli: Use new --call-nos=no call to "apitrace dump-images" for consistent results

Recent "apitrace trim" is now dropping uninteresting calls by
default. This means that the call numbers of rendering operations are
changing. Consequently, image comparisons were failing not due to
image-content differences, but simply because the filenames (with
embedded call numbers in them) no longer matched.

We can avoid this problem by using the --call-nos=no option which was
added to "apitrace dump-images" in very recent versions.

11 years agoPrint commands to be executed by cli_driver.py
Carl Worth [Sat, 11 Aug 2012 18:28:59 +0000 (11:28 -0700)]
Print commands to be executed by cli_driver.py

These aren't made visible unless CTEST_OUTPUT_ON_FAILURE in set, and
in that case it's quite convenient to see what the test was doing when
it failed.

11 years agoAdd a test to ensure "apitrace trim" performs proper dependency checking
Carl Worth [Thu, 9 Aug 2012 19:46:20 +0000 (12:46 -0700)]
Add a test to ensure "apitrace trim" performs proper dependency checking

Here we trim a trace by specifying (with --calls) only the final
glXSwapBuffers and then test that we can still produce a matching
image from the trace. This will only succeed if "apitrace trim"
performs dependency checking and includes many previous calls.

Of course, historically "apitrace trim" performed no such dependency
checks, so older versions of apitrace are expected to fail this test.

11 years agoAdd some comments to the recently-added cli tests.
Carl Worth [Thu, 9 Aug 2012 00:18:32 +0000 (17:18 -0700)]
Add some comments to the recently-added cli tests.

It's easy enough to ignore lines starting with a '#' and that lets us
make these tests more self-documenting.

11 years agoAdd a test that "apitrace diff-images" flags mismatching images.
Carl Worth [Wed, 8 Aug 2012 23:18:21 +0000 (16:18 -0700)]
Add a test that "apitrace diff-images" flags mismatching images.

With this test we add a new EXPECT_FAILURE: attribute to the script
syntax to indicate that a particular apitrace command in the script is
expected to fail. This requires manually invoking the Popen
constructor rather than using subprocess.check_output, (which is
*close* to what we need but fails to assign the output when raising an
exception).

We also remove the globbing from the CMakeLists.txt file to get a
manual ordering of the tests (rather than executing in alphabetic
order).

11 years agoAdd a new 'cli' subdirectory for higher-level testing of apitrace CLI.
Carl Worth [Wed, 8 Aug 2012 22:18:23 +0000 (15:18 -0700)]
Add a new 'cli' subdirectory for higher-level testing of apitrace CLI.

As described in the README, this new directory is for tests that
perform higher-level testing of the apitrace command-line interface
than either of the existing traces or apps directories.

Compared to traces, these new tests can do higher-level things like
dumping images from traces, comparing images, etc.

Compared to apps, these tests are intended to be portable across
multiple targets. (This isn't actually the case yet because commands
like "apitrace dump-images" currently work only on OpenGL. Also, even
when that is fixed, we will also need to then extend these tests to
have traces for each supported target for testing.)

In this commit, the only new test exercises "apitrace dump-images" and
"apitrace diff-images" on a simple trace file with one frame,
(tri.trace grabbed from apps/gl).

11 years agoAdd more README documentation on how existing test drivers are structured.
Carl Worth [Tue, 7 Aug 2012 22:47:53 +0000 (15:47 -0700)]
Add more README documentation on how existing test drivers are structured.

More than once, I've reverse-engineered how the test suite uses test
drivers (app_driver.py and tool_driver.py) to invoke scripts within
the apps/ and traces/ directory. In order to save my future-self some
work in doing this yet again, I've written some documentation in
README.markdown in each directory.

Hopefully this documentation will be useful for anyone wanting to
write additional tests.

11 years agoapps/d3d11: Comprehensive test.
José Fonseca [Tue, 27 Nov 2012 20:07:08 +0000 (20:07 +0000)]
apps/d3d11: Comprehensive test.

11 years agotracematch: Fix array parsing.
José Fonseca [Tue, 27 Nov 2012 20:06:40 +0000 (20:06 +0000)]
tracematch: Fix array parsing.

11 years agoUpdate readme.
José Fonseca [Tue, 27 Nov 2012 16:21:52 +0000 (16:21 +0000)]
Update readme.

11 years agoRemove left over debug statement.
José Fonseca [Tue, 27 Nov 2012 14:24:23 +0000 (14:24 +0000)]
Remove left over debug statement.

11 years agoAdd a shader d3d9 tri test.
José Fonseca [Tue, 27 Nov 2012 14:22:57 +0000 (14:22 +0000)]
Add a shader d3d9 tri test.

11 years agoPrecise d3d8-10.1 reference traces.
José Fonseca [Mon, 26 Nov 2012 19:50:35 +0000 (19:50 +0000)]
Precise d3d8-10.1 reference traces.

11 years agoFix parsing of floats without '.'
José Fonseca [Mon, 26 Nov 2012 19:49:17 +0000 (19:49 +0000)]
Fix parsing of floats without '.'

For example "1e+10"

11 years agoAccept comments in reference traces.
José Fonseca [Mon, 26 Nov 2012 19:48:54 +0000 (19:48 +0000)]
Accept comments in reference traces.

11 years agoHandle DOS line endings.
José Fonseca [Mon, 26 Nov 2012 19:48:37 +0000 (19:48 +0000)]
Handle DOS line endings.

11 years agoRetrace d3d8.
José Fonseca [Mon, 26 Nov 2012 19:48:04 +0000 (19:48 +0000)]
Retrace d3d8.

11 years agogl/map_buffer: Exit 1 when GL_ARB_map_buffer_range is not found.
José Fonseca [Mon, 26 Nov 2012 13:52:50 +0000 (13:52 +0000)]
gl/map_buffer: Exit 1 when GL_ARB_map_buffer_range is not found.

11 years agoOnly invoke pkg_check_modules when PKG_CONFIG_FOUND is true.
José Fonseca [Mon, 26 Nov 2012 13:51:51 +0000 (13:51 +0000)]
Only invoke pkg_check_modules when PKG_CONFIG_FOUND is true.

11 years agoUse clang on MacOSX.
José Fonseca [Mon, 26 Nov 2012 13:51:32 +0000 (13:51 +0000)]
Use clang on MacOSX.

11 years agoDrop pragmas.
José Fonseca [Sat, 24 Nov 2012 09:31:11 +0000 (09:31 +0000)]
Drop pragmas.

11 years agoRename checker.py -> tracematch.py
José Fonseca [Fri, 23 Nov 2012 22:15:01 +0000 (22:15 +0000)]
Rename checker.py -> tracematch.py

11 years agoImprove gl map buffer test.
José Fonseca [Fri, 23 Nov 2012 08:34:44 +0000 (08:34 +0000)]
Improve gl map buffer test.

11 years agoUse the new trace checker.
José Fonseca [Fri, 23 Nov 2012 07:52:17 +0000 (07:52 +0000)]
Use the new trace checker.

11 years agoFurther improvements to checker.
José Fonseca [Thu, 22 Nov 2012 22:03:17 +0000 (22:03 +0000)]
Further improvements to checker.

11 years agoImprove checker.
José Fonseca [Thu, 22 Nov 2012 09:55:15 +0000 (09:55 +0000)]
Improve checker.

11 years agoUse 'apitrace retrace'
José Fonseca [Thu, 22 Nov 2012 08:49:01 +0000 (08:49 +0000)]
Use 'apitrace retrace'

11 years agoSpecify rendertarget view descriptions.
José Fonseca [Tue, 20 Nov 2012 17:06:43 +0000 (17:06 +0000)]
Specify rendertarget view descriptions.

To exercise unions.

11 years agoAdd new retrace apis.
José Fonseca [Wed, 14 Nov 2012 09:13:25 +0000 (09:13 +0000)]
Add new retrace apis.

11 years agoAdd a d3d10 level 9 test case.
José Fonseca [Thu, 25 Oct 2012 10:45:59 +0000 (11:45 +0100)]
Add a d3d10 level 9 test case.

11 years agoUpdate state workarounds.
José Fonseca [Sun, 20 May 2012 10:16:46 +0000 (11:16 +0100)]
Update state workarounds.

11 years agoTest trimming.
José Fonseca [Sat, 19 May 2012 19:53:37 +0000 (20:53 +0100)]
Test trimming.

11 years agoMake tri_glsl test robust against attribute location changes.
José Fonseca [Mon, 14 May 2012 19:22:28 +0000 (20:22 +0100)]
Make tri_glsl test robust against attribute location changes.

11 years agoUpdate for floating point precision changes.
José Fonseca [Mon, 14 May 2012 19:21:59 +0000 (20:21 +0100)]
Update for floating point precision changes.

11 years agoPropagate apitrace trace error codes.
José Fonseca [Wed, 9 May 2012 13:18:22 +0000 (14:18 +0100)]
Propagate apitrace trace error codes.

11 years agoEnsure feature level 10.0 at minimum.
José Fonseca [Wed, 9 May 2012 11:01:33 +0000 (12:01 +0100)]
Ensure feature level 10.0 at minimum.

11 years agoAllow to build samples without apitrace source tree.
José Fonseca [Wed, 9 May 2012 10:14:08 +0000 (11:14 +0100)]
Allow to build samples without apitrace source tree.

11 years agoAllow to build d3d samples independently of apitrace source.
José Fonseca [Wed, 9 May 2012 10:10:17 +0000 (11:10 +0100)]
Allow to build d3d samples independently of apitrace source.

11 years agoRename hlsl d3dcommon.
José Fonseca [Wed, 9 May 2012 10:06:12 +0000 (11:06 +0100)]
Rename hlsl d3dcommon.

11 years agoAttempt of a d3d11.1 test.
José Fonseca [Wed, 9 May 2012 09:56:29 +0000 (10:56 +0100)]
Attempt of a d3d11.1 test.

11 years agod3d10.1 sample.
José Fonseca [Wed, 9 May 2012 09:28:25 +0000 (10:28 +0100)]
d3d10.1 sample.

11 years agoPut HLSL shaders into their own directory.
José Fonseca [Wed, 9 May 2012 08:26:35 +0000 (09:26 +0100)]
Put HLSL shaders into their own directory.

11 years agoMake OpenGL/GLUT/GLEW optional.
José Fonseca [Wed, 9 May 2012 08:25:19 +0000 (09:25 +0100)]
Make OpenGL/GLUT/GLEW optional.

11 years agod3d11 test.
José Fonseca [Tue, 8 May 2012 21:26:17 +0000 (22:26 +0100)]
d3d11 test.

11 years agoCleanup d3d10 test.
José Fonseca [Tue, 8 May 2012 18:26:03 +0000 (19:26 +0100)]
Cleanup d3d10 test.

11 years agoPrecompile d3d10 shader.
José Fonseca [Fri, 4 May 2012 10:35:48 +0000 (11:35 +0100)]
Precompile d3d10 shader.

11 years agoFixup d3d10 test.
José Fonseca [Fri, 4 May 2012 10:28:05 +0000 (11:28 +0100)]
Fixup d3d10 test.

11 years agoPrototype of d3d10 sample app.
José Fonseca [Thu, 3 May 2012 23:52:13 +0000 (00:52 +0100)]
Prototype of d3d10 sample app.

Compiles but untested.

11 years agoD3D7 sample.
José Fonseca [Thu, 3 May 2012 13:21:55 +0000 (14:21 +0100)]
D3D7 sample.

11 years agoD3D8 sample app.
José Fonseca [Thu, 3 May 2012 12:31:37 +0000 (13:31 +0100)]
D3D8 sample app.

11 years agoSimple D3D9 app.
José Fonseca [Thu, 3 May 2012 10:20:41 +0000 (11:20 +0100)]
Simple D3D9 app.

11 years agoHandle CRLF lines in tool_driver.py
José Fonseca [Thu, 3 May 2012 10:15:12 +0000 (11:15 +0100)]
Handle CRLF lines in tool_driver.py

12 years agoUpdate reference for GLboolean update.
José Fonseca [Mon, 16 Apr 2012 19:10:19 +0000 (20:10 +0100)]
Update reference for GLboolean update.

12 years agoPragmas.
José Fonseca [Sun, 18 Mar 2012 00:35:46 +0000 (00:35 +0000)]
Pragmas.

12 years agoBit more work on the checker.
José Fonseca [Sun, 18 Mar 2012 00:13:13 +0000 (00:13 +0000)]
Bit more work on the checker.

12 years agoAdd .gitignore.
José Fonseca [Sat, 17 Mar 2012 15:49:00 +0000 (15:49 +0000)]
Add .gitignore.

12 years agoTest callsets.
José Fonseca [Sat, 17 Mar 2012 15:44:02 +0000 (15:44 +0000)]
Test callsets.

12 years agoDump verbosely.
José Fonseca [Sat, 17 Mar 2012 15:11:28 +0000 (15:11 +0000)]
Dump verbosely.

12 years agoMake it easier to add more tests.
José Fonseca [Sat, 17 Mar 2012 14:50:04 +0000 (14:50 +0000)]
Make it easier to add more tests.

12 years agoBetter code organization.
José Fonseca [Sat, 17 Mar 2012 14:24:29 +0000 (14:24 +0000)]
Better code organization.

12 years agoSplit the driver code.
José Fonseca [Sat, 17 Mar 2012 14:13:33 +0000 (14:13 +0000)]
Split the driver code.

12 years agoBetter checking (WIP).
José Fonseca [Sun, 11 Mar 2012 15:48:38 +0000 (15:48 +0000)]
Better checking (WIP).

12 years agoMake PIL optional.
José Fonseca [Sun, 11 Mar 2012 14:21:10 +0000 (14:21 +0000)]
Make PIL optional.

12 years agoBasic map buffer test.
José Fonseca [Sat, 10 Mar 2012 10:33:58 +0000 (10:33 +0000)]
Basic map buffer test.

12 years agoUse path to apitrace executable instead.
José Fonseca [Fri, 2 Mar 2012 11:50:44 +0000 (11:50 +0000)]
Use path to apitrace executable instead.

12 years agoUse abs paths for traces.
José Fonseca [Fri, 2 Mar 2012 11:50:17 +0000 (11:50 +0000)]
Use abs paths for traces.

12 years agoAdd test for GL_EXT_debug_marker.
José Fonseca [Wed, 15 Feb 2012 10:07:18 +0000 (10:07 +0000)]
Add test for GL_EXT_debug_marker.

12 years agoFilter the difference to mitigate rasterization differences.
José Fonseca [Wed, 14 Dec 2011 23:19:33 +0000 (23:19 +0000)]
Filter the difference to mitigate rasterization differences.

12 years agoMore flexible image comparison.
José Fonseca [Mon, 12 Dec 2011 15:35:28 +0000 (15:35 +0000)]
More flexible image comparison.

12 years agoactually call adjustRefState.
José Fonseca [Mon, 12 Dec 2011 15:27:38 +0000 (15:27 +0000)]
actually call adjustRefState.

12 years agoUse non-overlapping names for traces.
José Fonseca [Mon, 12 Dec 2011 09:18:45 +0000 (09:18 +0000)]
Use non-overlapping names for traces.

12 years agoUse opaque clear color.
José Fonseca [Mon, 12 Dec 2011 09:17:28 +0000 (09:17 +0000)]
Use opaque clear color.

No intention of testing alpha at this point.

12 years agoRely on jsondiff to strip comments.
José Fonseca [Sun, 11 Dec 2011 13:38:19 +0000 (13:38 +0000)]
Rely on jsondiff to strip comments.

12 years agoCheck tri state.
José Fonseca [Sun, 11 Dec 2011 12:36:06 +0000 (12:36 +0000)]
Check tri state.

12 years agoTest single/double buffering.
José Fonseca [Sun, 11 Dec 2011 12:04:54 +0000 (12:04 +0000)]
Test single/double buffering.

12 years agoDon't force initial window position.
José Fonseca [Sun, 11 Dec 2011 11:44:48 +0000 (11:44 +0000)]
Don't force initial window position.

12 years agoUpdate readme.
José Fonseca [Sun, 11 Dec 2011 10:59:18 +0000 (10:59 +0000)]
Update readme.

12 years agoUpdate default state.
José Fonseca [Sun, 11 Dec 2011 10:53:19 +0000 (10:53 +0000)]
Update default state.

12 years agoAdjust for external bugs in reference state.
José Fonseca [Fri, 9 Dec 2011 17:40:12 +0000 (17:40 +0000)]
Adjust for external bugs in reference state.

12 years agoUpdate for texture environment state changes.
José Fonseca [Fri, 9 Dec 2011 17:03:23 +0000 (17:03 +0000)]
Update for texture environment state changes.

12 years agoWindows portability fixes.
José Fonseca [Fri, 9 Dec 2011 16:42:35 +0000 (16:42 +0000)]
Windows portability fixes.

12 years agoAdd tweaks/comments to default.ref.json
José Fonseca [Wed, 7 Dec 2011 12:03:23 +0000 (12:03 +0000)]
Add tweaks/comments to default.ref.json

12 years agoTest default state first.
José Fonseca [Wed, 7 Dec 2011 09:47:50 +0000 (09:47 +0000)]
Test default state first.

12 years agoSearch images in more framebuffer attachments.
José Fonseca [Wed, 7 Dec 2011 09:47:23 +0000 (09:47 +0000)]
Search images in more framebuffer attachments.

12 years agoFix the default.ref.txt.
José Fonseca [Wed, 7 Dec 2011 09:46:29 +0000 (09:46 +0000)]
Fix the default.ref.txt.

Did exactly the opposite I meant.

12 years agoDetect doublebuffered visuals on Mac OS X.
José Fonseca [Mon, 5 Dec 2011 08:32:56 +0000 (08:32 +0000)]
Detect doublebuffered visuals on Mac OS X.

12 years agoSplit default state checking into a separate test.
José Fonseca [Mon, 5 Dec 2011 08:28:55 +0000 (08:28 +0000)]
Split default state checking into a separate test.

12 years agoRemove variable default state.
José Fonseca [Sun, 4 Dec 2011 23:41:17 +0000 (23:41 +0000)]
Remove variable default state.

12 years agoDon't search for vg module.
José Fonseca [Sun, 4 Dec 2011 15:34:24 +0000 (15:34 +0000)]
Don't search for vg module.

12 years agoCheck against reference images/state.
José Fonseca [Sun, 4 Dec 2011 15:30:49 +0000 (15:30 +0000)]
Check against reference images/state.

12 years agoAdd forgetten reference file.
José Fonseca [Sun, 4 Dec 2011 15:00:03 +0000 (15:00 +0000)]
Add forgetten reference file.

12 years agoFix typo in varray app.
José Fonseca [Sun, 4 Dec 2011 14:58:07 +0000 (14:58 +0000)]
Fix typo in varray app.

12 years agoTest trace files too.
José Fonseca [Sun, 4 Dec 2011 00:43:24 +0000 (00:43 +0000)]
Test trace files too.

12 years agoDo a trial (e)gltrace run as part of the test.
José Fonseca [Sat, 3 Dec 2011 09:58:40 +0000 (09:58 +0000)]
Do a trial (e)gltrace run as part of the test.

12 years agoDistinguish better egl tests from others.
José Fonseca [Fri, 2 Dec 2011 11:06:37 +0000 (11:06 +0000)]
Distinguish better egl tests from others.

12 years agoDistinguish FF tri from GLSL tri.
José Fonseca [Fri, 2 Dec 2011 07:52:22 +0000 (07:52 +0000)]
Distinguish FF tri from GLSL tri.

12 years agoMention where test log are written.
José Fonseca [Fri, 25 Nov 2011 08:58:46 +0000 (08:58 +0000)]
Mention where test log are written.

12 years agoAutomate gles tests.
José Fonseca [Fri, 25 Nov 2011 08:58:42 +0000 (08:58 +0000)]
Automate gles tests.