fullstackpython.github.com/caching.html at gh-pages · FashtimeDotCom/fullstackpython.github.com

History

216 lines (214 loc) · 13.2 KB

Raw

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

128

129

130

131

132

133

134

135

136

137

138

139

140

141

142

143

144

145

146

147

148

149

150

151

152

153

154

155

156

157

158

159

160

161

162

163

164

165

166

167

168

169

170

171

172

173

174

175

176

177

178

179

180

181

182

183

184

185

186

187

188

189

190

191

192

193

194

195

196

197

198

199

200

201

202

203

204

205

206

207

208

209

210

211

212

213

214

215

216

<!DOCTYPE html>

<title>Caching - Full Stack Python</title>

<!--[if lt IE 9]>

<![endif]-->

<style>

.toc-indent {padding-left: 25px;}

.toc-more-indent {padding-left: 37px;}

</style>

(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){

(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),

m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)

})(window,document,'script','//www.google-analytics.com/analytics.js','ga');

ga('create', 'UA-19910497-7', 'auto');

ga('send', 'pageview');

</script> </head>

<body>

<span class="logo-title"><a href="/">Full Stack Python</a></span>

</div>

</div><div class="row">

<h1>Caching</h1>

<p>Caching can reduce the load on servers by storing the results of common

operations and serving the precomputed answers to clients. </p>

<p>For example, instead of retrieving data from database tables that rarely

change, you can store the values in-memory. Retrieving values from an

in-memory location is far faster than retrieving them from a database (which

stores them on a persistent disk like a hard drive.) When the cached values

change the system can invalidate the cache and re-retrieve the updated values

for future requests.</p>

<p>A cache can be created for multiple layers of the stack. </p>

<h2>Caching backends</h2>

<ul>

<li>

<p><a href="http://memcached.org/">memcached</a> is a common in-memory caching system.</p>

</li>

<li>

<p><a href="http://redis.io/">Redis</a> is a key-value in-memory data store that can

easily be configured for caching with libraries such as

<a href="https://github.com/sebleier/django-redis-cache">django-redis-cache</a>.</p>

</li>

</ul>

<h2>Caching resources</h2>

<ul>

<li>

<p>"<a href="https://bjornjohansen.no/caching-varnish-or-nginx">Caching: Varnish or Nginx?</a>"

reviews some considerations such as SSL and SPDY support when choosing

reverse proxy Nginx or Varnish.</p>

</li>

<li>

<p><a href="http://bizcoder.com/caching-is-hard-draw-me-a-picture">Caching is Hard, Draw me a Picture</a>

has diagrams of how web request caching layers work. The post is relevant

reading even though the author is describing his Microsoft code as the

impetus for writing the content.</p>

</li>

</ul>

<h2>Caching learning checklist</h2>

Analyze your web application for the slowest parts. It's likely there are

complex database queries that can be precomputed and stored in an in-memory

data store.</p>

Leverage your existing in-memory data store already used for session data

to cache the results of those complex database queries.

A <a href="/task-queues.html">task queue</a> can often be used to precompute the results

on a regular basis and save them in the data store.</p>

Incorporate a cache invalidation scheme so the precomputed results remain

accurate when served up to the user.</p>

<h3>What do you want to learn now that your app is responding faster?</h3>

How do I run Python outside the HTTP request-response cycle?

</p>

</div>

</a>

What can I learn about my users through web analytics?

</p>

</div>

What should I know about security to protect my app?

</p>

</div>

How do I automate the server configuration that I set up?

</p>

</div>

</div> <div id="mc_embed_signup">

<h4>Interested in major updates to this site or an alert when a complete Full Stack Python book with detailed example code is released? Sign up here and you'll an occasional email only when there's big news to report.</h4>

</div>

</div>

</form>

</div>

<h3 class="panel-head"><a href="/table-of-contents.html" style="color: #fff;">Table of Contents</a></h3>

</div>

<a href="/introduction.html" class="list-group-item smaller-item ">Introduction</a>

<a href="/why-use-python.html" class="list-group-item smaller-item ">Why Use Python?</a>

<a href="/development-environments.html" class="list-group-item smaller-item ">Development Environments</a>

<a href="/best-python-resources.html" class="list-group-item smaller-item ">Best Python Resources</a>

<a href="/web-frameworks.html" class="list-group-item smaller-item ">Web Frameworks</a>

<a href="/django.html" class="list-group-item smaller-item ">Django</a>

<a href="/flask.html" class="list-group-item smaller-item ">Flask</a>

<a href="/bottle.html" class="list-group-item smaller-item ">Bottle</a>

<a href="/pyramid.html" class="list-group-item smaller-item ">Pyramid</a>

<a href="/morepath.html" class="list-group-item smaller-item ">Morepath</a>

<a href="/other-web-frameworks.html" class="list-group-item smaller-item ">Other Web Frameworks</a>

<a href="/web-design.html" class="list-group-item smaller-item ">Web Design</a>

<a href="/cascading-style-sheets.html" class="list-group-item smaller-item ">Cascading Style Sheets</a>

<a href="/javascript.html" class="list-group-item smaller-item ">JavaScript</a>

<a href="/websockets.html" class="list-group-item smaller-item ">WebSockets</a>

<a href="/web-application-security.html" class="list-group-item smaller-item ">Web Application Security</a>

<a href="/databases.html" class="list-group-item smaller-item ">Databases</a>

<a href="/no-sql-datastore.html" class="list-group-item smaller-item ">NoSQL Data Stores</a>

<a href="/application-programming-interfaces.html" class="list-group-item smaller-item ">Application Programming Interfaces</a>

<a href="/api-integration.html" class="list-group-item smaller-item ">API Integration</a>

<a href="/api-creation.html" class="list-group-item smaller-item ">API Creation</a>

<a href="/deployment.html" class="list-group-item smaller-item ">Deployment</a>

<a href="/servers.html" class="list-group-item smaller-item ">Servers</a>

<a href="/platform-as-a-service.html" class="list-group-item smaller-item ">Platform-as-a-service</a>

<a href="/operating-systems.html" class="list-group-item smaller-item ">Operating Systems</a>

<a href="/web-servers.html" class="list-group-item smaller-item ">Web Servers</a>

<a href="/wsgi-servers.html" class="list-group-item smaller-item ">WSGI Servers</a>

<a href="/source-control.html" class="list-group-item smaller-item ">Source Control</a>

<a href="/application-dependencies.html" class="list-group-item smaller-item ">Application Dependencies</a>

<a href="/static-content.html" class="list-group-item smaller-item ">Static Content</a>

<a href="/task-queues.html" class="list-group-item smaller-item ">Task Queues</a>

<a href="/configuration-management.html" class="list-group-item smaller-item ">Configuration Management</a>

<a href="/continuous-integration.html" class="list-group-item smaller-item ">Continuous Integration</a>

<a href="/logging.html" class="list-group-item smaller-item ">Logging</a>

<a href="/monitoring.html" class="list-group-item smaller-item ">Monitoring</a>

<a href="/web-analytics.html" class="list-group-item smaller-item ">Web Analytics</a>

<a href="/docker.html" class="list-group-item smaller-item ">Docker</a>

<a href="/caching.html" class="list-group-item smaller-item active">Caching</a>

<a href="/code-metrics.html" class="list-group-item smaller-item ">Code Metrics</a>

<a href="/what-full-stack-means.html" class="list-group-item smaller-item ">What "Full Stack" Means</a>

<a href="/change-log.html" class="list-group-item smaller-item ">Change Log</a>

<a href="/future-directions.html" class="list-group-item smaller-item ">Future Directions</a>

<a href="/about-author.html" class="list-group-item smaller-item ">About the Author</a>

</div>

<div class="panel-heading"><h3 class="panel-head">Caching</h3></div>

Need more detailed tutorials and walkthroughs than you see here?

<a href="/email.html">Sign up for an email alert when that content is created.</a>

<hr/>

<a href="/">Full Stack Python</a> is an open book that explains

concepts in plain language and provides the most helpful resources

on those topics.

<hr/>

<a href="http://twitter.com/mattmakai">Matt Makai</a> built

this site with appreciated assistance from

<a href="https://github.com/makaimc/fullstackpython.github.com/pulls">pull requests</a>.

</div>

</div></div>

<hr/>

<a href="http://www.mattmakai.com/" class="underline">Matt Makai</a>

2015

</div>

</body>

</html>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

FilesExpand file tree

caching.html

Latest commit

History

caching.html

File metadata and controls