Skip to main content

Inexpensive, Non-realtime Sites using Queues


A lot of the sites for small and medium businesses rely on dynamic engines (such as ASP.NET, PHP, etc) to generate most of the content at run-time. This kind of typical setup requires expensive hosting (relative to a small and medium size company) and (if not designed properly) may not perform very well. I would like to argue that most of those sites could be served with static HTML pages generated offline at different time intervals (either fixed or on-demand intervals, discussed later) and a Javascript Client front end that communicates with a slim server side service whose only job is to store commands from visitors into a queue. The queue can then be read and processed by non-hosted computers, freeing the business from having to pay extra hosting fees for application server.


The costs are reduced by the following:
  1. Static HTML sites mean less power required.
  2. Queue storages are usually cheaper services than full SQL Databases.
  3. A slim service that just relays the commands from the user to the queue and from the queue to the user should require less power than a full blown Web Application.

Static HTML sites do not require a high end server to achieve great performance. In fact, static HTML sites can take advantage of CDN and client caching. Many cloud services such as Google App Engine provide a generous quota for static content. To generate the static site, one could use many of the static site generators out there, one example is Jekyll.

A lot of user interaction in a small or medium business’ (SMB) public site do not require the ACID properties of SQL Databases. A simple Queue can reliably ensure storage of the visitor’s request for future processing, for example, a customer’s request to buy a product only needs to be stored in the Queue for the off-cloud Application Processor to retrieve it from the cloud’s queue and then do what it needs to do to process the sale. Cloud SQL databases can be expensive (e.g SQL Server on Azure), but queues such as GAE’s Queue are inexpensive and have quotas for free usage.

By having as little code running in the cloud, the cost of processing minutes can be saved. In the customer purchase example, the code to process the sale does not need to live in expensive clouds, it could live in an on-premises regular computer that checks the queue every so often. The computer that does the heavy processing can also be placed on another cheaper hosted environment if that is required by the business needs. The point is that your public facing site (the front line of your business) is as quick as possible and your back-end services (that do not require real time responses) can be placed in inexpensive environments (on-premises or a hosting provider).

Obviously, an application must be designed to make reliable Application Processors that can scale horizontally (i.e. more Application Processors can be added without impacting reliability). The back-end database to which the Application Processors connect can still be a SQL ACID database, but it does not need to be in the cloud anymore. In the customer purchase example, the sale and its details would go to its normal SQL Database after processed.

In the next posts, I will be linking to examples of sites with content that take advantage of content generated at deployment time. I will also linkt o examples using slim services that take advantage of cheap or free code hosting such as Google App Engine and Azure Websites.

Comments

Post a Comment

Popular posts from this blog

Power Automate: SFTP action "Test connection failed"

When I added an SFTP create file action to my Power Automate flow ( https://flow.microsoft.com ) , I got the following error in the action step, within the designer: "Test connection failed" To troubleshoot the Power Automate connection, I had to: go the Power Automate portal then "Data"->"Connections"  the sftp connection was there, I clicked on the ellipsis, and entered the connection info It turns out, that screen provides more details about the connection error. In my case, it was complaining that "SSH host key finger-print xxx format is not supported. It must be in 'MD5' format". I had provided the sha fingerprint that WinScp shows. Instead, I needed to use the MD5 version of the fingerprint. To get that, I had to run in command line (I was in a folder that had openssh in it): ssh -o FingerprintHash=md5 mysftpsite.com To get the fingerprint in MD5 format. I took the string (without the "MD5:" part of the string) and put ...
Post a Comment
Read more

How to create online multiplayer HTML5 games in Contruct2

  Construct2 can use websockets to send and receive messages between games. By using socket-io , we can use a Node.js script as the server and my modification to the socket-io plugin for Construct2 to allow the games to synchronize data between them in real-time. There are two parts to this design: the Node.js server and the Construct2 clients (the games playing). The main part of building an online multiplayer HTML5 game is to plan: how the clients will communicate how often and what to communicate how much of the logic will go into the server and how much to the client. In my sample game, I chose to have each client own a player and have the server just relay messages: Use string messages in the form TypeOfMessage, Parameter1, Paremeter2, Parater3, etc to communicate. Have the clients send their player position about 16 times a second. Whenever their player shoots, the client needs to send a message immediately. Almost all of the game logic will...
9 comments
Read more

How to use Windows SSO with OpenXava

One of the nice things about the .NET web environment is the dead easy way to implement Single Sign On in your web apps through Active Directory authentication. In the Java world there are multiple alternatives to use Windows’ Single Sign On with Java based web apps. One of those alternatives is Waffle . Waffle allows your Java web app to authenticate against Active Directory groups (and users). The only caveat is that your web server needs to be running in Windows, which kind of makes sense. In this article, you will learn the steps required to have your OpenXava web application use Waffle to authenticate your Windows users. The first step is to download Waffle from their site and then copy the JAR files outlined in https://github.com/dblock/waffle/blob/master/Docs/tomcat/TomcatSingleSignOnValve.md to the OpenXava’s tomcat server. In your OpenXava project, create servlets.xml in the Web-inf, containing the following: <!-- the role name (the domain gorup) must be e...
Post a Comment
Read more