|
ABSTRACT
While algorithms for cooperative proxy caching have been widely studied, little is understood about cooperative-caching performance in the large-scale World Wide Web environment. This paper uses both trace-based analysis and analytic modelling to show the potential advantages and drawbacks of inter-proxy cooperation. With our traces, we evaluate quantitatively the performance-improvement potential of cooperation between 200 small-organization proxies within a university environment, and between two large-organization proxies handling 23,000 and 60,000 clients, respectively. With our model, we extend beyond these populations to project cooperative caching behavior in regions with millions of clients. Overall, we demonstrate that cooperative caching has performance benefits only within limited population bounds. We also use our model to examine the implications of future trends in Web-access behavior and traffic.
REFERENCES
Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.
| |
1
|
|
| |
2
|
|
 |
3
|
Thomas E. Anderson , Michael D. Dahlin , Jeanna M. Neefe , David A. Patterson , Drew S. Roselli , Randolph Y. Wang, Serverless network file systems, ACM Transactions on Computer Systems (TOCS), v.14 n.1, p.41-79, Feb. 1996
[doi> 10.1145/225535.225537]
|
 |
4
|
|
| |
5
|
L. Breslau, P. Cao, L. Fan, G. Phillips, and S. Shenker. Web caching and Zipf-like distributions: Evidence and implications. In Prec. of IEEE INFOCOM '99, pages 126-134, March 1999.
|
| |
6
|
R. Caceres, F. Douglis, A. Feldmann, G. Glass, and M. Rabinovich. Web proxy caching: The devil is in the details. In Workshop on Internet Server Performance, pages 111-118, June 1998.
|
| |
7
|
P. Cao. Characterization of Web proxy traffic and Wisconsin proxy benchmark 2.0. http://www, cs.wisc.edu/ ~cao/w3c-webchar-position, Nov. 1998.
|
| |
8
|
P. Cao and S. Irani. Cost-aware WWW proxy caching algorithms. In Prec. of the 1st USENIX Syrup. on Internet Technologies and Systems, pages 193-206, Dec. 1997.
|
| |
9
|
A. Chankhunthod, P. B. Danzig, C. Neerdaels, M. F. Schwartz, and K. J. Worrell. A hierarchical Intemet object cache. In Prec. of the 1996 USENIX Technical Conf., pages 153-163, January 1996.
|
 |
10
|
|
| |
11
|
|
| |
12
|
P. Danzig. NetCache architecture and deployment. In Prec. of the 3rd Int. WWW Caching Workshop, http ://wwwc ache.j a. net/events/workshop/01/NetCache- 3_2.pdf, June 1998.
|
| |
13
|
F. Douglis, A. Feldmann, B. Krishnamurthy, and J. Mogul. Rate of change and other metrics: a live study of the World Wide Web. In Prec. of the 1st USENIX Syrup. on Internet Technologies and Systems, pages 147-158, Dec. 1997.
|
| |
14
|
B. Duska, D. Marwood, and M. J. Feeley. The measured access characteristics of World Wide Web client proxy caches. In Prec. of the 1st USENIX Syrup. on Internet Technologies and Systems, pages 23-36, Dec. 1997.
|
| |
15
|
EMC Corporation, http://www'emc'c~m/pr~ducts/enterprise-st~rage-systems/systems'htm' Symmetrix 3000 and 5000 Enterprise Storage Systems Product Description Guide, 1999.
|
 |
16
|
Li Fan , Pei Cao , Jussara Almeida , Andrei Z. Broder, Summary cache: a scalable wide-area Web cache sharing protocol, Proceedings of the ACM SIGCOMM '98 conference on Applications, technologies, architectures, and protocols for computer communication, p.254-265, August 31-September 04, 1998, Vancouver, British Columbia, Canada
|
 |
17
|
M. J. Feeley , W. E. Morgan , E. P. Pighin , A. R. Karlin , H. M. Levy , C. A. Thekkath, Implementing global memory management in a workstation cluster, Proceedings of the fifteenth ACM symposium on Operating systems principles, p.201-212, December 03-06, 1995, Copper Mountain, Colorado, United States
|
| |
18
|
A. Feldmann, R. Caceres, F. Douglis, G. Glass, and M. Rabinovich. Performance of web proxy caching in heterogeneous bandwidth environments. In Prec. of IEEE INFOCOM ' 99, March 1999.
|
| |
19
|
|
| |
20
|
S. D. Gribble and E. A. Brewer. System design issues for Internet middleware services: Deductions from a large client trace. In Prec. of the 1st USENIX Syrup. on Internet Technologies and Systems, pages 207-218, Dec. 1997.
|
| |
21
|
David Karger , Alex Sherman , Andy Berkheimer , Bill Bogstad , Rizwan Dhanidina , Ken Iwamoto , Brian Kim , Luke Matkins , Yoav Yerushalmi, Web caching with consistent hashing, Proceeding of the eighth international conference on World Wide Web, p.1203-1213, May 1999, Toronto, Canada
|
| |
22
|
|
| |
23
|
|
| |
24
|
T. M. Kroeger, J. C. Mogul, and C. Maltzahn. Digital's Web proxy traces, ftp://ftp.digital.com/pub/DEC/ traces/proxy/webtraces.html, August 1996.
|
| |
25
|
S. R. Lawrence and C. L. Giles. Accessibility of information on the Web. Nature, 400(6740):107-109, July 1999.
|
| |
26
|
|
| |
27
|
|
| |
28
|
Scott Michel , Khoi Nguyen , Adam Rosenstein , Lixia Zhang , Sally Floyd , Van Jacobson, Adaptive web caching: towards a new global caching architecture, Computer Networks and ISDN Systems, v.30 n.22-23, p.2169-2177, Nov. 25, 1998
[doi> 10.1016/S0169-7552(98)00246-3
]
|
| |
29
|
J. C. Mogul. Network behavior of a busy web server and its clients. Technical Report 95/5, DEC Western Research Laboratory, Oct. 1995.
|
| |
30
|
M. Rabinovich, J. Chase, and S. Gadde. Not all hits are created equal: Cooperative proxy caching over a wide area network. In Prec. of the 3rd Int. WWW Caching Workshop, June 1998.
|
| |
31
|
A. Rousskov, D. Wessels, and G. Chisholm. The first ircache web cache bake-off. Technical report, National Laboratory for Applied Network Research, April 1999.
|
| |
32
|
Squid internet object cache, http://squid.nlanr.net.
|
| |
33
|
|
| |
34
|
J. Touch. The LSAM proxy cache - a multicast distributed virtual cache. In Prec. of the 3rd Int. WWW Caching Workshop, June 1998.
|
| |
35
|
V. Valloppillil and K. W. Ross. Cache array routing protocol v l.0. ftp://ftp.isi.edu/internet-drafts/draftvinod-carp-v 1-03.txt, Feb. 1998.
|
| |
36
|
|
| |
37
|
A. Wolman, G. Voelker, N. Sharma, N. Cardwell, M. Brown, T. Landray, D. Pinnel, A. Karlin, and H. Levy. Organization-based analysis of Web-object sharing and caching. In Prec. ef the 2nd USENIX Syrup. on Internet Technologies and Systems, Oct. 1999.
|
CITED BY 80
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Alan Berfield , Bill Simons , Panos K. Chrysanthis , Kirk Pruhs, Better client OFF time prediction to improve performance in web information systems, Proceedings of the 3rd international workshop on Web information and data management, November 09-01, 2001, Atlanta, Georgia, USA
|
|
|
|
|
|
|
|
|
|
|
|
Jaeyeon Jung , Emil Sit , Hari Balakrishnan , Robert Morris, DNS performance and the effectiveness of caching, Proceedings of the 1st ACM SIGCOMM Workshop on Internet Measurement, November 01-02, 2001, San Francisco, California, USA
|
|
|
|
Valeria Cardellini , Philip S. Yu , Yun-Wu Huang, Collaborative proxy system for distributed Web content transcoding, Proceedings of the ninth international conference on Information and knowledge management, p.520-527, November 06-11, 2000, McLean, Virginia, United States
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Claudia Canali , Valeria Cardellini , Michele Colajanni , Riccardo Lancellotti , Philip S. Yu, Cooperative architectures and algorithms for discovery and transcoding of multi-version content, Web content caching and distribution: proceedings of the 8th international workshop, Kluwer Academic Publishers, Norwell, MA, 2004
|
|
Yanyan Wang , Matthew J. Rutherford , Antonio Carzaniga , Alexander L. Wolf, Automating experimentation on distributed testbeds, Proceedings of the 20th IEEE/ACM international Conference on Automated software engineering, November 07-11, 2005, Long Beach, CA, USA
|
|
|
|
|
|
|
Jian Yin , Lorenzo Alvisi , Mike Dahlin , Arun Iyengar, Engineering server-driven consistency for large scale dynamic Web services, Proceedings of the 10th international conference on World Wide Web, p.45-57, May 01-05, 2001, Hong Kong, Hong Kong
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Alec Wolman , Geoff Voelker , Nitin Sharma , Neal Cardwell , Molly Brown , Tashana Landray , Denise Pinnel , Anna Karlin , Henry Levy, Organization-based analysis of web-object sharing and caching, Proceedings of the 2nd conference on USENIX Symposium on Internet Technologies and Systems, p.3-3, October 11-14, 1999, Boulder, Colorado
|
|
|
|
|
|
|
|
|
|
|
|
Limin Wang , Kyoung Soo Park , Ruoming Pang , Vivek Pai , Larry Peterson, Reliability and security in the CoDeeN content distribution network, Proceedings of the USENIX Annual Technical Conference 2004 on USENIX Annual Technical Conference, p.14-14, June 27-July 02, 2004, Boston, MA
|
|
|
|
|
|
|
|
L. Bent , M. Rabinovich , G. M. Voelker , Z. Xiao, Characterization of a large web site population with implications for content delivery, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA
|
|
Jun-Hong Cui , Michalis Faloutsos , Dario Maggiorini , Mario Gerla , Khaled Boussetta, Measuring and modelling the group mmbership in the internet, Proceedings of the 3rd ACM SIGCOMM conference on Internet measurement, October 27-29, 2003, Miami Beach, FL, USA
|
|
Manish Anand , Edmund B. Nightingale , Jason Flinn, Ghosts in the machine: interfaces for better power management, Proceedings of the 2nd international conference on Mobile systems, applications, and services, June 06-09, 2004, Boston, MA, USA
|
|
|
Parikshit Gopalan , Howard Karloff , Aranyak Mehta , Milena Mihail , Nisheeth Vishnoi, Caching with expiration times, Proceedings of the thirteenth annual ACM-SIAM symposium on Discrete algorithms, p.540-547, January 06-08, 2002, San Francisco, California
|
|
|
|
|
Ann Chervenak , Ewa Deelman , Ian Foster , Leanne Guy , Wolfgang Hoschek , Adriana Iamnitchi , Carl Kesselman , Peter Kunszt , Matei Ripeanu , Bob Schwartzkopf , Heinz Stockinger , Kurt Stockinger , Brian Tierney, Giggle: a framework for constructing scalable replica location services, Proceedings of the 2002 ACM/IEEE conference on Supercomputing, p.1-17, November 16, 2002, Baltimore, Maryland
|
|
|
|
|
|
Bharat Chandra , Mike Dahlin , Lei Gao , Amjad-Ali Khoja , Amol Nayate , Asim Razzaq , Anil Sewani, Resource management for scalable disconnected access to Web services, Proceedings of the 10th international conference on World Wide Web, p.245-256, May 01-05, 2001, Hong Kong, Hong Kong
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Bharat Chandra , Mike Dahlin , Lei Gao , Amol Nayate, End-to-end WAN service availability, Proceedings of the 3rd conference on USENIX Symposium on Internet Technologies and Systems, p.9-9, March 26-28, 2001, San Francisco, California
|
|
|
|
Stefan Saroiu , Krishna P. Gummadi , Richard J. Dunn , Steven D. Gribble , Henry M. Levy, An analysis of internet content delivery systems, Proceedings of the 5th symposium on Operating systems design and implementation Due to copyright restrictions we are not able to make the PDFs for this conference available for downloading, December 09-11, 2002, Boston, Massachusetts
|
|
|
|
|
|
|
Krishna P. Gummadi , Richard J. Dunn , Stefan Saroiu , Steven D. Gribble , Henry M. Levy , John Zahorjan, Measurement, modeling, and analysis of a peer-to-peer file-sharing workload, Proceedings of the nineteenth ACM symposium on Operating systems principles, October 19-22, 2003, Bolton Landing, NY, USA
|
|
|
Ronald P. Doyle , Jeffrey S. Chase , Omer M. Asad , Wei Jin , Amin M. Vahdat, Model-based resource provisioning in a web service utility, Proceedings of the 4th conference on USENIX Symposium on Internet Technologies and Systems, p.5-5, March 26-28, 2003, Seattle, WA
|
|
|
|
|
|
|
|
Marc Ségura-Devillechaise , Jean-Marc Menaud , Gilles Muller , Julia L. Lawall, Web cache prefetching as an aspect: towards a dynamic-weaving based solution, Proceedings of the 2nd international conference on Aspect-oriented software development, p.110-119, March 17-21, 2003, Boston, Massachusetts
|
|
|
|
|
|
|
|
M. Schrefl , M. Bernauer , E. Kapsammer , B. Pröll , W. Retschitzegger , T. Thalhammer, Self-maintaining web pages, Information Systems, v.28 n.8, p.1005-1036, December 2003
|
|
|
|
|
|
|
|
|
Alexander Moshchuk , Tanya Bragin , Damien Deville , Steven D. Gribble , Henry M. Levy, SpyProxy: execution-based detection of malicious web content, Proceedings of 16th USENIX Security Symposium on USENIX Security Symposium, p.1-16, August 06-10, 2007, Boston, MA
|
|
|
|
|
|
|
|
|
Peer to Peer - Readers of this Article have also read:
-
Data structures for quadtree approximation and compression
Communications of the ACM
28, 9
Hanan Samet
-
A hierarchical single-key-lock access control using the Chinese remainder theorem
Proceedings of the 1992 ACM/SIGAPP Symposium on Applied computing
Kim S. Lee
, Huizhu Lu
, D. D. Fisher
-
The GemStone object database management system
Communications of the ACM
34, 10
Paul Butterworth
, Allen Otis
, Jacob Stein
-
Putting innovation to work: adoption strategies for multimedia communication systems
Communications of the ACM
34, 12
Ellen Francik
, Susan Ehrlich Rudman
, Donna Cooper
, Stephen Levine
-
An intelligent component database for behavioral synthesis
Proceedings of the 27th ACM/IEEE conference on Design automation
Gwo-Dong Chen
, Daniel D. Gajski
|