We at Francium love to use lean database clients to connect to databases. We enjoy using pgcli. It is a python based, open source postgres client for those willing to use lean and simple but powerful tool.
Object Pooling is one of the widely used design patterns by software developers. One of the easiest examples I could cite is the Database Connection Pooling. I would like to quickly demonstrate a real use case where we made use of it. Object Pool Pattern is extremely useful when cost of object creation is very high.
One of the most common things that is done these days is to collect information about anything and everything present in the public domain, kind of unstructured data and decipher/decode patterns to get some valuable information. There are many sources to get such information, but websites for this purpose are the most popular. One can write a simple scraper that could iteratively go through the pages within a predefined depth and get back all the content displayed which could then be used for doing various sort of analytics.
A website is a very crucial factor for any company and we recently went live with ours. It is like your public face or a house address. The Landing or Home page is equivalent to visiting your office and seeing how aesthetic the reception area is to give that first impression. It is super vital to keep it clean, informative, and to top it all to be extremely secure from the plethora of web attacks seen in the recent times.
At Francium tech, Scalability is not an option, but something thats mandatory. We deal with huge volumes of data and have to run millions of atomic jobs every day to keep our systems up to date and extremely competitive. And our requirements to scale is not going to go down any time soon, in fact, it is going to only increase exponentially in future. This leaves us with adopting to bleeding edge infrastructures, and adapt them very fast!
The outset of Bitcoin proved that we can exchange money without any third party intervention through distribution among multiple nodes via blockchain. However, Bitcoin stores only the transactional information. In order to develop truly decentralised apps, we need to store the states.
At Francium tech, we constantly try to push our limits when it comes to Technology and Elasticsearch is a natural fit to run our various scalability tests. Because of this attitude, we were able to scale our long running tasks (in days) to within hours which has to process close to 13 Million Documents.