DataStandardisation » History » Version 10

Anonymous, 10/29/2007 08:58 AM

1 7 Anonymous
= The ProCKSI "stand-alone" ''Core'' Application =
2 1 Anonymous
3 4 Anonymous
ProCKSI utilises a variety of similarity comparison methods (e.g. USM, MaxCMO, TMaling, ...) producing different similarity measures  (e.g. Zscore, TMscore, RMSD, ...) each. Each of the comparison methods produces output with different formats and additional content such as alignments, rotation matrix, etc. Some of them produce just one output file, others a set of linked HTML files.
4 1 Anonymous
5 7 Anonymous
Additionally, there are pre- and post-processing methods, e.g. preparation of contact maps from structures, or clustering of similarity matrices, that have their own input parameters and produce different output.
6 1 Anonymous
7 7 Anonymous
The goal can be described as follows: [[br]]
8 7 Anonymous
Allow the  ProCKSI "stand-alone" ''core'' application to 
9 9 Anonymous
 1. be developped independently from the ProCKSI ''framework'' or ''server'' (incl. webserver/database), and allow collaborators to seamlessly integrate their own methods. One might even think of making the code publically available and allow the community to improve it.
10 7 Anonymous
 2. run on any (Linux) machine that has the necessary methods installed. This can be either a collaborator's desktop machine, the ProCKSI cluster, the University Cluster, or even a machine on the Grid.
11 7 Anonymous
 3. further distribute the given task using local machines, Grid and Web Service technology in order to obtain their results without the need to schedule everything from one central point (''Orchestration'' vs. ''Choreography'').
12 7 Anonymous
 4. return its results in a standardised format that can easily be integrated into the ProCKSI database and thus resused be the ProCKSI framework and all other experiments "on the command line".
13 7 Anonymous
14 7 Anonymous
15 7 Anonymous
= Standardising Results with XML =  
16 1 Anonymous
17 8 Anonymous
The principle API for the ProCKSI "stand-alone" ''core'' application can be visualised as follows:
18 8 Anonymous
19 8 Anonymous
[[Image(ProCKSI-core-API.png)]]
20 8 Anonymous
21 8 Anonymous
One file in XML format is fed into the ProCKSI "stand-alone" ''core'' application, describing the entire dataset, all tasks and the necessary input parameters. At the end, one output file in XML format is written, which might link to further external files in specific format (e.g. PDF, CM, ...) if necessary.
22 8 Anonymous
23 8 Anonymous
24 1 Anonymous
== Input Specifications ==
25 8 Anonymous
This is the latest proposal for the XML input file:
26 1 Anonymous
27 9 Anonymous
In principle, all possible results from the requested methods are returned. All unnecessary results can be requested to be excluded. A log file is generated if a file name is provided.
28 9 Anonymous
29 9 Anonymous
Optional tags: '''exclude''' (measure, result), '''log'''[[BR]]
30 6 Paweł Widera
Optional attributes: '''description'''
31 1 Anonymous
32 1 Anonymous
{{{
33 10 Anonymous
<package id="ID" description="TEXT">
34 5 Paweł Widera
  <log filename="FILENAME" />
35 5 Paweł Widera
  
36 10 Anonymous
  <dataset type="structure|tree|contact map|similarity matrix">
37 5 Paweł Widera
    <item id="ID" label="TEXT" filename="FILENAME" />
38 6 Paweł Widera
    :::
39 5 Paweł Widera
    <item id="ID" label="TEXT" filename="FILENAME" />
40 10 Anonymous
  </dataset>  
41 1 Anonymous
42 10 Anonymous
  <parameterset id="ID" name="TEXT">
43 5 Paweł Widera
    <param name="TEXT">VALUE</param>
44 6 Paweł Widera
    :::
45 5 Paweł Widera
    <param name="TEXT">VALUE</param>
46 1 Anonymous
47 5 Paweł Widera
    <exclude>
48 5 Paweł Widera
      <measure>NAME</measure>
49 6 Paweł Widera
      :::
50 5 Paweł Widera
      <measure>NAME</measure>
51 5 Paweł Widera
      
52 5 Paweł Widera
      <result>NAME</result>
53 6 Paweł Widera
      :::
54 6 Paweł Widera
      <result>NAME</result>
55 1 Anonymous
    </exclude>
56 10 Anonymous
  </parameterset>
57 10 Anonymous
58 10 Anonymous
</package>
59 1 Anonymous
}}}
60 9 Anonymous
61 9 Anonymous
The data used as an input could be protein structures, similarity trees, contact maps or similarity matrices. All specified methods should be able to operate on given data files. This dependency could be verified automatically using XML Schema.
62 9 Anonymous
63 9 Anonymous
== Output Specifications ==
64 1 Anonymous
This is the latest proposal for the XML output file:
65 9 Anonymous
66 1 Anonymous
Optional tags: '''log''', '''message''', '''similarity''' (used only if output is a ''comparison'') [[BR]]
67 8 Anonymous
Optional attributes: '''description''', '''node''', '''start''', '''end''', '''ref_id''' (only if output type is ''composition''), '''ref_id2''' (only if output type is not ''comparison'')
68 6 Paweł Widera
69 6 Paweł Widera
{{{
70 10 Anonymous
<package id="ID" description="TEXT" node="TEXT" start="TIME" end="TIME">
71 6 Paweł Widera
  <log filename="FILENAME" />
72 1 Anonymous
73 1 Anonymous
  <message type="error|warning|info">TEXT</message>
74 6 Paweł Widera
  :::
75 6 Paweł Widera
  <message type="error|warning|info">TEXT</message>
76 6 Paweł Widera
  
77 10 Anonymous
  <dataset type="structure|tree|contact map|similarity matrix">
78 6 Paweł Widera
    <item id="ID" label="TEXT" filename="FILENAME" />
79 6 Paweł Widera
    :::
80 6 Paweł Widera
    <item id="ID" label="TEXT" filename="FILENAME" />
81 10 Anonymous
  </dataset>  
82 6 Paweł Widera
83 10 Anonymous
  <parameterset>
84 6 Paweł Widera
    <method id="ID" name="NAME">
85 1 Anonymous
      <parameter name="TEXT">VALUE</parameter>
86 1 Anonymous
      :::
87 1 Anonymous
      <parameter name="TEXT">VALUE</parameter>
88 6 Paweł Widera
    </method>
89 6 Paweł Widera
    :::
90 1 Anonymous
    <method ...>
91 6 Paweł Widera
      ...
92 1 Anonymous
    </method>
93 10 Anonymous
  </parameterset>
94 6 Paweł Widera
95 10 Anonymous
  <results type="transformation|comparison|composition" ref_id="" ref_id2=" ">
96 6 Paweł Widera
    <method id="ID">
97 6 Paweł Widera
      <message type="error|warning|info">TEXT</message>
98 6 Paweł Widera
      :::
99 6 Paweł Widera
      <message type="error|warning|info">TEXT</message>
100 6 Paweł Widera
101 6 Paweł Widera
      <similarity measure="NAME">VALUE</similarity>
102 6 Paweł Widera
      :::
103 6 Paweł Widera
      <similarity measure="NAME">VALUE</similarity>
104 6 Paweł Widera
105 6 Paweł Widera
      <file type="TEXT" label="TEXT" name="FILENAME" />
106 6 Paweł Widera
      :::
107 1 Anonymous
      <file type="TEXT" label="TEXT" name="FILENAME" />
108 1 Anonymous
    <method>
109 10 Anonymous
  </results>
110 10 Anonymous
  
111 10 Anonymous
</package>
112 9 Anonymous
}}}
113 9 Anonymous
114 10 Anonymous
Message being an error, warning or additional information could be passed on a global or a method level. Dataset and parameterset defined in the input file (package) could be repeated in the output (results) if needed (self-contained output). Output could be a 1->1 transformation (e.g. structure -> contact map), a 2->1 comparison (e.g. 2*structure -> similarity measure) or N->1 composition (e.g. N*tree -> total tree or N*similarity matrix -> consensus similarity matrix). The results other than similarity measures for a pair of proteins are stored in external files and are just referenced from the XML file.
115 9 Anonymous
116 10 Anonymous
The alignment data could be described in the XML file, as there is no single format used by all programs.