Conformance Testing

Overview

We consider three major categories of XPDL/BPMN-conformant software:

• Import – An enactment engine or simulator might only be able to import.
• Export – Some modelers and BPA tools may only be able to export.
• Import/Export -- A typical XPDL/BPMN modeling tool can do both.

Within each category we specifically recognize BPMN portability conformance, which we subdivide into the three classes: SIMPLE, STANDARD and COMPLETE. These classes are defined in the XPDL 2.1 specification. We have developed an XSL Transform that performs structural and conformance checks on XPDL documents including Portability Class.

Import

A tool must be able to import any XML document with the following three properties:

• The document satisfies the XPDL 2.1 schema.
• The document passes the structural integrity test performed by the XSLT.
• The tool must not discard parts of the document that it does not understand (relevant only if the tool can also export). These may include:
• Extended Attributes
• User name spaces
• Elements and attributes in a portability conformance class above that which the tool claims to support

If the tool claims graphical portability conformance it must be able to display the imported diagram if the diagram conformance class is equal to or a subset of the tool’s conformance class. The displayed elements must use the defined BPMN shapes, line types and icons. The node and connector graphics info in the document should be used to determine the size and position of all displayed graphical objects.

Export

The XML document exported by the tool must have the following two properties:

• The document satisfies the XPDL 2.1 schema.
• The document passes the structural integrity test performed by the XSLT.

If the portability class attribute is present in the document, the document must not contain elements and attributes from a higher conformance class. The XSLT tests for this. Furthermore, the node and connector graphics info in the document must correspond to the elements in the diagram as displayed by the tool, if in fact the tool has a graphical BPMN display.

Import/Export

A tool claiming Import/Export conformance must obviously be able to satisfy the individual Import and Export requirements stated above. In addition it must be able to

• Import, edit in some way and then export the model, without losing extended attributes or user name space XML unless their parent elements were deleted during the editing.

If the tool claims graphical portability conformance it must:

• Be able to create all test diagrams with class contained in or equal to its claimed class.
• Be able to export such diagrams.

Procedures

The WfMC will make available test diagrams for the different conformance classes and XSLT validation programs that help check the XPDL serialization produced by a vendor modeling tool for these test diagrams. Currently certification is available for the two conformance classes SIMPLE and STANDARD as defined in XPDL 2.1 (BPMN 1.x supported). Certification can be for Import only, Output only, or Input and Output.

A vendor applying for certification will schedule a teleconference and WEBEX (or equivalent) session with a WfMC approved certifier. (Four hours should be set aside for this teleconference).

Input Certification will require demonstration of the following:

• Loading the test XPDL file into the tool.
• Displaying the model graphically such that the graphics is a reasonable approximation of the original test model.
• Editing or demonstrating ability of the tool to work with the imported model.

Output Certification will require demonstration of the following:

• Building the test model.
• the test model as an XPDL file that is schema-correct and passes the XSLT serialization validation.
• Can be loaded into at least one of the already validated tools.

Input and Output Certification will require all of the above and in addition:

• Import the test XPDL file (with additional extensions).
• Edit it, adding some elements.
• Export the edited model, preserving the additional extensions.

The Certifier will document any problems encountered during the certification session and explain them to the applicant. These problems may include:

• Schema violations.
• Lack of structural integrity.
• Loss of XML.
• Graphical issues.

The applicant may fix the problems and re-apply,

If certification is granted, the certificate will state the specific Import, Export and Graphical Portability conformance capabilities.

Charges for Certification:

• WfMC Full Members: $3,500
• Non-members: $7,000
• Re-submissions: $2,500

Technical Assistance from WfMC Recommended Consultant

Rate determined by consultant

Package price for assistance in passing certification and thorough review of product:

• $20,000

Submission to Extend Certification

If a previously certified tool has been extended to handle Import and Export or a higher conformance class, vender may apply for extended certificate.

• The Charge for any extension will be: $1,000

XPDL2.2 (BPMN2.0)

The WfMC will offer certification for XPDL2.2 when that specification is complete. A certified tool that is upgraded to handle XPDL2.2 can be re-certified at a special discount of 50% off the price established for XPDL2.2 certification.

Contact Robert Shapiro (rshapiro@processanalytica.com) to discuss your certification needs.

• XPDL Portability Validation
• XPDL Conformance Project
• XPDL Implementation Guidelines