|
PROJECT BENCHMARK REPORTS
An organization can compare the performance of
a software project to similar projects in the International Software
Benchmarking Standards Group (ISBSG) repository. The following paragraphs
describe the process to follow. There is no charge for this service,
other than permission to add the data submitted to the ISBSG repository.
Submitting a Project to ISBSG and Receiving
a Project Benchmark Report (PBR)
You can submit project data to the International
Software Benchmarking Standards Group Ltd. (ISBSG) and receive a
Project Benchmark Report (PBR), which is returned via email or regular
mail. The PBR compares the submitted project against similar projects
in the ISBSG Repository.
For example, assume your project has the following
characteristics:
 |
Development Platform = Mid-range |
 |
Methodology = Developed in-house |
 |
Language Type = 4GL |
 |
Maximum Team size > 8 |
Further, assume your Project Delivery Rate (PDR)
was 10.0 hours per Function Point
Given these parameters, you would receive a PBR,
which would include the following table with your PDR shown in bold
type.
| Influencing Factor |
N |
P10% |
P25% |
Med |
|
P75% |
|
P90% |
| Development Platform Mid-range |
52 |
1.6 |
2.6 |
5.6 |
|
8.2 |
*10 |
12.4 |
| Methodology Developed In-House |
98 |
1.3 |
2.1 |
4.8 |
*10 |
10.9 |
|
20.0 |
| Language Type 4GL |
149 |
1.5 |
2.3 |
5.4 |
|
9.6 |
*10 |
14.2 |
| Maximum Team Size
>8 |
43 |
4.5 |
6.4 |
9.1 |
*10 |
15.6 |
|
23.0 |
Also, for the two factors with the most significant
impact on productivity, Development Platform and Language Type,
a chart is prepared showing how your Project Delivery Rate compares
to projects with the same Development Platform and Language Type.
In this a way business can, for little out-of-pocket
cost and minimal effort, benchmark their projects against similar
projects from other organizations. This service is offered for free
to companies that submit their projects for inclusion in the ISBSG
Repository.
Submitting Project Data
Project data is collected and analyzed using a standard set of forms
and procedures developed by ISBSG. The forms and procedures define
the type of data to be collected (e.g., functional size, work-effort,
duration, and various attributes of the project). They also define
how the data will be validated, stored and published so as to guarantee
the integrity of the data and the confidentiality of the submitting
organization. Many of these procedures and definitions are implicitly
contained in the data collection and submission tool, Venturi, which
has been developed to assist in the collection and submission of
data.

Submitting data is a three-step process:
 |
Obtain the Venturi Data
Collection Package. Click
here to download a free copy of Venturi from the ISBSG website.
If you experience problems or require the software on diskette,
contact the IFPUG Office for assistance. |
 |
Enter the data for your
project. The IFPUG Benchmark data collection forms can be completed
in approximately 30 to 45 minutes, if you have the information
readily available. If you choose to submit data for several
projects, the time to enter data for the second and subsequent
projects is usually less than 15 minutes. The types of information
you will asked to provide are: |
| |
|
Baseline Function Point
data for the completed project (new or enhancement) required
data |
| |
|
Project work-effort
data (hours charged to the project) required data. |
| |
|
Post-Implementation
(after 30 days) defect data optional. |
| |
|
Project estimating
data optional. |
| |
|
Project and environment
characteristics some optional, some required. |
 |
Transmit the data to
ISBSG. The Venturi Data Collection Package has an export function,
which will allow you to export the data you entered. This export
file (stored in an ASCII format) can then be attached to an
E-mail message and submitted for inclusion in the ISBSG Repository
through the Internet (e.g., using CompuServe) to the ISBSG Repository
Registrar (current address will be found in Venturi). The subject
line should say ISBSG Benchmarking Repository Submission. Please
note that ISBSG cannot guarantee the security of the transmission.
However, following receipt of the file normal ISBSG security
and confidentiality will apply. |
You may also transmit the data:
 |
As an ASCII file (exported from
Venturi) on a 3.5" diskette; or |
 |
In Hard Copy using the Paper Forms.
|
In either case, mail the diskette or forms to the
IFPUG Office (Attention: IT Performance Committee), or directly
to the ISBSG Repository Registrar in Australia (the current address
will be found in Venturi).
Once received, the information identifying the contributor
will be removed from and filed separately. The data will then go
through a validation process. If it does not pass the validation
process, clarification will be requested through the IFPUG Office.
When it completes the validation process, a Project Benchmark Report
will be generated and forwarded to the contributor.
Confidentiality of Contributors
The confidentiality of organizations contributing project data is
protected through a series of measures:
 |
All personnel with
access to the data are required to adhere to a signed confidentiality
agreement. |
 |
The data collection
formats, from the Venturi software to the paper forms, are designed
so that the section that contains information identifying the
contributing organization can be easily removed. Once the project
data is received, an internal project number is assigned to
both the contributor information and the project data. The two
sections are then separated and stored separately and securely. |
 |
Data is not included
in reports unless there are enough contributing organizations
to mask the identity of all contributors. |
|