Often scientists need to locate appropriate software for their problems and then select from among many alternatives. We have previously proposed an approach for dealing with this task by processing performance data of the targeted software. This approach has been tested using a customized implementation referred to as PYTHIA. This experience made us realize the complexity of the algorithmic discovery of knowledge from performance data and of the management of these data together with the discovered knowledge. To address this issue, we created PYTHIA-II—a modular framework and system which combines a general knowledge discovery in databases (KDD) methodology and recommender system technologies to provide advice about scientific software/hardware artifacts. The functionality and effectiveness of the system is demonstrated for two existing performance studies using sets of software for solving partial differential equations. From the end-user perspective, PYTHIA-II allows users to specify the problem to be solved and their computational objectives. In turn, PYTHIA-II (i) selects the software available for the user's problem (ii) suggests parameter values, and (iii) assesses the recommendation provided. PYTHIA-II provides all the necessary facilities to set up database schemas for testing suites and associated performance data in order to test sets of software. Moreover, it allows easy interfacing of alternative data mining and recommendation facilities. PYTHIA-II is an open-ended system implemented on public domain software and has been used for performance evaluation in several different problem domains.

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Vikram S. Adve , Rajive Bagrodia , James C. Browne , Ewa Deelman , Aditya Dube , Elias N. Houstis , John R. Rice , Rizos Sakellariou , David J. Sundaram-Stukel , Patricia J. Teller , Mary K. Vernon, POEMS: End-to-End Performance Design of Large Parallel Adaptive Computational Systems, IEEE Transactions on Software Engineering, v.26 n.11, p.1027-1048, November 2000  [doi>10.1109/32.881716 ]
	2	BOISVERT,R.F.,RICE,J.R.,AND HOUSTIS, E. N. 1979. A system for performance evaluation of partial differential equations software. IEEE Transactions on Software Engineering SE-5, 4, 418-425.
	3	Ivan Bratko , Stephen Muggleton, Applications of inductive logic programming, Communications of the ACM, v.38 n.11, p.65-70, Nov. 1995  [doi>10.1145/219717.219771]
	4	DYKSEN, W., HOUSTIS, E., LYNCH, R., AND RICE, J. 1984. The performance of the collocation and Galerkin methods with Hermite bicubics. SIAM Journal of Numerical Analysis 21, 695-715.
	5	DYKSEN, W., RIBBENS, C., AND RICE, J. 1988. The performance of numerical software methods for elliptic problems with mixed boundary conditions. Numer. Meth. Partial Differential Eqs. 4, 347-361.
	6	Sašo Džeroski, Inductive logic programming and knowledge discovery in databases, Advances in knowledge discovery and data mining, American Association for Artificial Intelligence, Menlo Park, CA, 1996
	7	Usama M. Fayyad , Gregory Piatetsky-Shapiro , Padhraic Smyth, From data mining to knowledge discovery: an overview, Advances in knowledge discovery and data mining, American Association for Artificial Intelligence, Menlo Park, CA, 1996
	8	HOLLANDER,M.AND WOLFE, D. 1973. Non-parametric Statistical Methods. John Wiley and Sons.
	9	HOUSTIS,E.AND RICE, J. R. 1982. High order methods for elliptic partial differential equations with singularities. Inter. J. Numer. Meth. Engin. 18, 737-754.
	10	HOUSTIS, C., HOUSTIS, E., RICE, J., VARADAGLOU, P., AND PAPATHEODOROU, T. 1991. Athena: a knowledge based system for //ELLPACK. Symbolic-Numeric Data Analysis and Learning, 459-467.
	11	HOUSTIS, E., LYNCH, R., RICE, J., AND PAPATHEODOROU, T. 1978. Evaluation of numerical methods for elliptic partial differential equations. Journal of Comp. Physics 27, 323-350.
	12	E. N. Houstis , J. R. Rice , S. Weerawarana , A. C. Catlin , P. Papachiou , K.-Y. Wang , M. Gaitatzes, PELLPACK: a problem-solving environment for PDE-based applications on multicomputer platforms, ACM Transactions on Mathematical Software (TOMS), v.24 n.1, p.30-73, March 1998  [doi>10.1145/285861.285864]
	13	HOUSTIS,E.N.,MITCHELL, W., AND PAPATHEODOROU, T. 1983. Performance evaluation of algorithms for mildly nonlinear elliptic partial differential equations. Inter. J. Numer. Meth. Engin. 19, 665-709.
	14	Anupam Joshi , Sanjiva Weerawarana , Narendran Ramakrishnan , Elias N. Houstis , John R. Rice, Neuro-Fuzzy Support for Problem-Solving Environments: A Step Toward Automated Solution of PDEs, IEEE Computational Science & Engineering, v.3 n.1, p.44-56, March 1996  [doi>10.1109/99.486760 ]
	15	KOHAVI, R. 1996. MLC11 developments: data mining using MLC11.In S.E.A.KASIF Ed., Working Notes of the AAAI-96 Fall Symposia on 'Learning Complex Behaviors in Adaptive Intelligent Systems', pp. 112-123. AAAI Press.
	16	MOORE, P., OZTURAN, C., AND FLAHERTY, J. 1990. Towards the automatic numerical solution of partial differential equations. In Intelligent Mathematical Software Systems (North-Holland, 1990), pp. 15-22.
	17	MUGGLETON, S. 1995. Inverse entailment and PROGOL. New Generation Computing Vol. 13, pages 245-286.
	18	MUGGLETON,S.AND FENG, C. 1990. Efficient induction of logic programs. In S. ARIKAWA,S.
	19	GOTO,S.OHSUGA, AND T. YOKOMORI Eds., Proceedings of the First International Conference on Algorithmic Learning Theory, pp. 368-381. Japanese Society for Artificial Intelligence, Tokyo.
	20	MUGGLETON,S.AND RAEDT, L. D. 1994. Inductive logic programming: theory and methods. Journal of Logic Programming 19, 20, 629-679.
	21	OLSTON, C., WOODRUFF, A., AIKEN, A., CHU, M., ERCEGOVAC, V., LIN, M., SPALDING, M., AND
	22	Chris Olston , Allison Woodruff , Alexander Aiken , Michael Chu , Vuk Ercegovac , Mark Lin , Mybrid Spalding , Michael Stonebraker, DataSplash, Proceedings of the 1998 ACM SIGMOD international conference on Management of data, p.550-552, June 01-04, 1998, Seattle, Washington, United States
	23	J. R. Quinlan, Induction of Decision Trees, Machine Learning, v.1 n.1, p.81-106  [doi>10.1023/A:1022643204877]
	24	Narendran Ramakrishnan , Elias N. Houstis, Recommender systems of problem-solving environments, 1997
	25	RAMAKRISHNAN, N., HOUSTIS, E., AND RICE, J. 1998. Recommender Systems for Problem Solving Environments. In H. KAUTZ Ed., Working notes of the AAAI-98 workshop on recommender systems. AAAI/MIT Press.
	26	RAMAKRISHNAN, N., RICE, J., AND HOUSTIS, E. N. 2000. GAUSS: An on-line algorithm recommender system for one-dimensional numerical quadrature. ACM Trans. Math. Soft., to appear.
	27	Paul Resnick , Hal R. Varian, Recommender systems, Communications of the ACM, v.40 n.3, p.56-58, March 1997  [doi>10.1145/245108.245121]
	28	RICE, J. 1976. The algorithm selection problem. Advances in Computers 15, 65-118.
	29	RICE, J. 1983. Performance analysis of 13 methods to solve the Galerkin method equations. Lin. Alg. Appl. 53, 533-546.
	30	RICE, J. 1990. Software performance evaluation papers in TOMS. Technical Report CSD-TR- 1026, Dept. Comp. Sci., Purdue University.
	31	Michael Stonebraker , Lawrence A. Rowe, The design of POSTGRES, Proceedings of the 1986 ACM SIGMOD international conference on Management of data, p.340-355, May 28-30, 1986, Washington, D.C., United States
	32	Vassilios Verykios , Elias N. Houstis, Knowledge discovery in scientific databases (data mining), 1999
	33	Mining the Performance of Complex Systems, Proceedings of the 1999 International Conference on Information Intelligence and Systems, p.606, March 31-April 03, 1999
	34	Vassilios S. Verykios , Elias N. Houstis , John R. Rice, A knowledge discovery methodology for the performance evaluation of scientific software, Neural, Parallel & Scientific Computations, v.8 n.2, p.115-132, June 1, 2000
	35	Sanjiva Weerawarana , Elias N. Houstis , John R. Rice , Anupam Joshi , Catherine E. Houstis, PYTHIA: a knowledge-based system to select scientific algorithms, ACM Transactions on Mathematical Software (TOMS), v.22 n.4, p.447-468, Dec. 1996  [doi>10.1145/235815.235820]

• Data structures for quadtree approximation and compression Communications of the ACM   28, 9
  Hanan Samet
  
  
• A hierarchical single-key-lock access control using the Chinese remainder theorem Proceedings of the 1992 ACM/SIGAPP Symposium on Applied computing
  Kim S. Lee ,  Huizhu Lu ,  D. D. Fisher
  
  
• The GemStone object database management system Communications of the ACM   34, 10
  Paul Butterworth ,  Allen Otis ,  Jacob Stein
  
  
• Putting innovation to work: adoption strategies for multimedia communication systems Communications of the ACM   34, 12
  Ellen Francik ,  Susan Ehrlich Rudman ,  Donna Cooper ,  Stephen Levine
  
  
• An intelligent component database for behavioral synthesis Proceedings of the 27th ACM/IEEE conference on Design automation
  Gwo-Dong Chen ,  Daniel D. Gajski