[ Goto: CVS Test Source repository | Latest Test Bundles | Report a Test Bug ]

Platform Test Status


RESOURCES NEEDED

We are actively seeking support (both financial and other resources) to create further deliverables. A more detailed description is available on request. All qualified companies are invited to submit a proposal for development of each deliverable. Thanks to Intel for funding the LSB-OS testset.


CURRENT STATUS

Updated March 2 2003

Initial test coverage for LSB 1.3 is complete. Further extensions are being worked for rollout in Summer 2003, and for LSB 2.0 in 2004.

Test suites are available as source test suites, and as binary runtime versions which are used for formal LSB certification testing.

The current architecture and test totals for the LSB runtime environments for LSB 1.2 and LSB 1.3 are shown below:

Platform Testing today

Platform testing consists of the following:

  1. Runtime Environment test suite
    • Binary testing
    • Subsets standards tests
    • Excludes header file testing from source
    • Excludes utilities not in runtime environment
    • Additional LSB Specific tests
      LSB-FHS
      LSB Usergroups
    • Library Checker, Application checker
    • LSB developed tools

Areas for extension

C++ Testing

Proposed to package up as a separate test. Separate test suite to existing platform tests Utilize existing tests ? Requires a journal that can be audited

VSW4 vs VSW5

Required to increase test coverage significantly. Needs to be runtime only coverage.Most likely source VSW4. Resource needed.

VSTHlite

Included in LSB 1.3 runtime tests. Not executed by default. Possible switch on for 2.0?

AIO

Included in LSB 1.2/1.3 runtime tests. Not executed by default. Possible switch on for 2.0?

PAM

Included in LSB 1.3 Specification. Tests under development . To be integrated into runtime tests. Target for inclusion in Mid Year 2003.

Regression testing

Possibility to wrap tests being developed at posixtest.sourceforge.net, so an auditable test journal can be produced.

Platform Test Futures 2.0


Milestone Targets

M1 : Test framework and initial testsets.

The first milestone was setting up the test framework for integrating tests into. The framework adopted is the Test Environment Toolkit, with the VSXgen (generic VSX test framework) layered on top of that. As proof of concept the first testsets, the LSB-VSX and LSB-FHS testsets were integrated into the framework
Status: Complete

M2 : Additional testsets (Core OS).

This milestone produced additional testsets for the core glibc interfaces.These were developed as several testsets ( LSB-FHS rework for 2.2, LSB-OS, LSB-USERGROUPS). under the TET/VSXgen framework, thereby freeing resource to concentrate on testcase issues rather than framework.

M3 : Binary Versions of some of the above testsets

This milestone produced binary versions of some the above test sets for formal LSB test and certification processes. Candidate binary certification test suites are now being produced See the LSB Certification web site for information on the latest binary certification test suites.

M4 : Evolution for LSB 1.3 and later

This milestone is one of tracking the LSB specification and adding new testsets. The initial merge for LSB1.3 has been to add in the LI18NUX 2000 Level 1 tests. Further testsets are planned for later releases (see earlier in this document).


DELIVERABLES

We expect to add additional deliverables, these are the major ones we have identified for now.

Date Title of deliverable Type Probability Resources Needed Assumptions and Dependencies
People Financial
 Q2 2000  Test Framework for Platform Certification  Software  Status: Complete  AJ,CY     The first milestone was setting up the test framework for integrating tests into. The framework adopted is the Test Environment Toolkit, with the VSXgen (generic VSX test framework) layered on top of that. This allows additional testsets to be plugged in thereby extending coverage.
 Q2 2000  LSB-VSX (test coverage for core POSIX.1)  Testset for Platform Certification  Status: Complete  AJ,CY     The LSB-VSX testset has been integrated so it can be auto installed and configured on Linux systems. It is included in the certification testset
 Q2 2000  LSB-FHS (test coverage for the filesystem hierarchy standard)  Testset for Platform Certification  Status: Complete  AJ,CY     The LSB-FHS testset has been integrated so it can be auto installed and configured on Linux systems. It can also be merged with the LSB-VSX testset under VSXgen. It was reworked for FHS2.2 and is included in the certification testset.
 Q4 2002  VSTHlite (test coverage for core pthreads)  Testset for Platform, not currently in certification set  Status: Complete  AJ,CY     The VSTHlite testset is integrated under the VSXgen layer. There are no plans to use this test suite for certification due to the differences between Linux threads and POSIX threads. It is included in the testsets for LSB1.3 but not activated by default.
 Q1 2001  LSB-OS (additional test coverage for core libc behavior above LSB-VSX)  Testset for Platform Certification  Status: Complete.  AJ,ATT,AD,GWC,CY  Yes   The LSB-OS testset is integrated under the VSXgen layer, and has been merged with the other testsets. It is now GA and is included in the certification test suite releases.
 ?? ???  LSB-COMMANDS (Commands and Utilities test coverage  Testset for Platform, not currently in certification set  Status: Ongoing, further integration needed and initial results on Linux need to analyzed. The VSClite test suite can be downloaded.  AJ,??  Yes   This test package tests the commands and utilities for POSIX compliance. There are no plans to use this test suite for the initial LSB certification. Further evaluation is needed, for the moment this item is deferred pending the 2.0 futures move to a new base.
 Q4 2001  LSB-USRGROUPS (Testset for User/Groups specification  Testset for Platform Certification  Status: Complete.  KC,AJ  No   This test package test the user and groups specification. Kevin is leading the activity. This is now complete and is included in the test suite release for certification.
 Q4 2001  LSB-HDR also known as devchk -for development environment certification  Testset  Status: Complete  JJ  Yes   The LSB-HDR testset is for the binary values in the headers. This testset is now complete. It will be used as part of the formal certification tests if a program is put in place for the Development Environment.
 Ongoing  Binary Test suites  Binary packages for Platform certification  Status: Ongoing  CY  Yes   For formal certification binary versions of test suites are required. Its an ongoing activity to maintain these for each supported test architecture.
 Q2 2003  PAM Tests  Testset for PAM interfaces for Platform certification  Status: Underway  Wipro  No   A set of tests for the PAM interfaces are under development. Targeted for inclusion in the runtime testsets in mid year 2003.
 Q2 2003  X Tests  Runtime testset for X11 interfaces for Platform certification  Status: TBD  ??  Yes   A standalone binary runtime test suite for X11. Based on VSW4. Targeted for inclusion in the runtime testsets in mid year 2003, subject to resource being found.