DataStandardisation » History » Version 7

Anonymous, 10/05/2007 11:41 PM

1 7 Anonymous
= The ProCKSI "stand-alone" ''Core'' Application =
2 1 Anonymous
3 4 Anonymous
ProCKSI utilises a variety of similarity comparison methods (e.g. USM, MaxCMO, TMaling, ...) producing different similarity measures  (e.g. Zscore, TMscore, RMSD, ...) each. Each of the comparison methods produces output with different formats and additional content such as alignments, rotation matrix, etc. Some of them produce just one output file, others a set of linked HTML files.
4 1 Anonymous
5 7 Anonymous
Additionally, there are pre- and post-processing methods, e.g. preparation of contact maps from structures, or clustering of similarity matrices, that have their own input parameters and produce different output.
6 1 Anonymous
7 7 Anonymous
The goal can be described as follows: [[br]]
8 7 Anonymous
Allow the  ProCKSI "stand-alone" ''core'' application to 
9 7 Anonymous
 1. be developped independently from the ProCKSI ''framework'' (incl. webserver/database), and allow collaborators to seamlessly integrate their own methods. One might even think of making the code publically available and allow the community to improve it.
10 7 Anonymous
 2. run on any (Linux) machine that has the necessary methods installed. This can be either a collaborator's desktop machine, the ProCKSI cluster, the University Cluster, or even a machine on the Grid.
11 7 Anonymous
 3. further distribute the given task using local machines, Grid and Web Service technology in order to obtain their results without the need to schedule everything from one central point (''Orchestration'' vs. ''Choreography'').
12 7 Anonymous
 4. return its results in a standardised format that can easily be integrated into the ProCKSI database and thus resused be the ProCKSI framework and all other experiments "on the command line".
13 7 Anonymous
14 7 Anonymous
15 7 Anonymous
16 7 Anonymous
= Standardising Results with XML =  
17 7 Anonymous
18 7 Anonymous
== Input Specifications ==
19 7 Anonymous
20 6 Paweł Widera
Optional tags: '''exclude''' (measure, result), '''log''' (no log is generated if not specified) [[BR]]
21 6 Paweł Widera
Optional attributes: '''description'''
22 1 Anonymous
23 1 Anonymous
{{{
24 5 Paweł Widera
<job id="ID" description="TEXT">
25 5 Paweł Widera
  <log filename="FILENAME" />
26 5 Paweł Widera
  
27 5 Paweł Widera
  <input type="structure|tree|contact map|similarity matrix">
28 5 Paweł Widera
    <item id="ID" label="TEXT" filename="FILENAME" />
29 6 Paweł Widera
    :::
30 5 Paweł Widera
    <item id="ID" label="TEXT" filename="FILENAME" />
31 5 Paweł Widera
  </input>  
32 1 Anonymous
33 5 Paweł Widera
  <method id="ID" name="TEXT">
34 5 Paweł Widera
    <param name="TEXT">VALUE</param>
35 6 Paweł Widera
    :::
36 5 Paweł Widera
    <param name="TEXT">VALUE</param>
37 1 Anonymous
38 5 Paweł Widera
    <exclude>
39 5 Paweł Widera
      <measure>NAME</measure>
40 6 Paweł Widera
      :::
41 5 Paweł Widera
      <measure>NAME</measure>
42 5 Paweł Widera
      
43 6 Paweł Widera
      <result>NAME</result>
44 5 Paweł Widera
      :::
45 5 Paweł Widera
      <result>NAME</result>
46 5 Paweł Widera
    </exclude>
47 6 Paweł Widera
  </method>
48 6 Paweł Widera
  :::
49 1 Anonymous
  <method ...>
50 1 Anonymous
    ...
51 1 Anonymous
  </method>
52 1 Anonymous
</job>
53 1 Anonymous
}}}
54 1 Anonymous
55 7 Anonymous
The ''<job>'' might be renamed into ''<packages>>'', the ''<input>'' into ''<dataset>'', in order to be consistent with the [wiki:DataStorage Extended Database Design].
56 7 Anonymous
57 1 Anonymous
The data used as an input could be protein structures, similarity trees, contact maps or similarity matrices. All specified methods should be able to operate on given data files. This dependency could be verified automatically using XML Schema.
58 6 Paweł Widera
59 7 Anonymous
== Output Specifications ==
60 6 Paweł Widera
61 6 Paweł Widera
Optional tags: '''log''', '''message''', '''similarity''' (used only if output is a ''comparison'') [[BR]]
62 6 Paweł Widera
Optional attributes: '''description''', '''node''', '''start''', '''end''', '''ref_id''' (only if output type is ''composition''), '''ref_id2''' (only if output type is not ''comparison'')
63 6 Paweł Widera
64 6 Paweł Widera
{{{
65 6 Paweł Widera
<job id="ID" description="TEXT" node="TEXT" start="TIME" end="TIME">
66 6 Paweł Widera
  <log filename="FILENAME" />
67 6 Paweł Widera
68 6 Paweł Widera
  <message type="error|warning|info">TEXT</message>
69 6 Paweł Widera
  :::
70 6 Paweł Widera
  <message type="error|warning|info">TEXT</message>
71 6 Paweł Widera
  
72 6 Paweł Widera
  <input type="structure|tree|contact map|similarity matrix">
73 6 Paweł Widera
    <item id="ID" label="TEXT" filename="FILENAME" />
74 6 Paweł Widera
    :::
75 6 Paweł Widera
    <item id="ID" label="TEXT" filename="FILENAME" />
76 6 Paweł Widera
  </input>  
77 6 Paweł Widera
78 6 Paweł Widera
  <parameters>
79 6 Paweł Widera
    <method id="ID" name="NAME">
80 6 Paweł Widera
      <parameter name="TEXT">VALUE</parameter>
81 6 Paweł Widera
      :::
82 6 Paweł Widera
      <parameter name="TEXT">VALUE</parameter>
83 6 Paweł Widera
    </method>
84 6 Paweł Widera
    :::
85 6 Paweł Widera
    <method ...>
86 6 Paweł Widera
      ...
87 6 Paweł Widera
    </method>
88 6 Paweł Widera
  </parameters>
89 6 Paweł Widera
90 6 Paweł Widera
  <output type="transformation|comparison|composition" ref_id="" ref_id2=" ">
91 6 Paweł Widera
    <method id="ID">
92 6 Paweł Widera
      <message type="error|warning|info">TEXT</message>
93 6 Paweł Widera
      :::
94 6 Paweł Widera
      <message type="error|warning|info">TEXT</message>
95 6 Paweł Widera
96 6 Paweł Widera
      <similarity measure="NAME">VALUE</similarity>
97 6 Paweł Widera
      :::
98 6 Paweł Widera
      <similarity measure="NAME">VALUE</similarity>
99 6 Paweł Widera
100 6 Paweł Widera
      <file type="TEXT" label="TEXT" name="FILENAME" />
101 6 Paweł Widera
      :::
102 6 Paweł Widera
      <file type="TEXT" label="TEXT" name="FILENAME" />
103 6 Paweł Widera
    <method>
104 6 Paweł Widera
  </output>
105 6 Paweł Widera
  :::
106 6 Paweł Widera
  <output ...>
107 6 Paweł Widera
    ...
108 6 Paweł Widera
  </output>
109 6 Paweł Widera
</job>
110 6 Paweł Widera
}}}
111 6 Paweł Widera
112 6 Paweł Widera
Message being an error, warning or additional information could be passed on a global or a method level. Input data and parameters defined in the input file could be repeated in the output if needed (self-contained output). Output could be a 1->1 transformation (e.g. structure -> contact map), a 2->1 comparison (e.g. 2*structure -> similarity measure) or N->1 composition (e.g. N*tree -> total tree or N*similarity matrix -> consensus similarity matrix). The results other than similarity measures for a pair of proteins are stored in external files and are just referenced from the XML file.
113 6 Paweł Widera
114 6 Paweł Widera
The alignment data could be described in the XML file, as there is no single format used by all programs. This yet to be decided.