Category Archives: redis

Skyrave @ Skyrock Radio

La Skyrave était l’émission des musiques électroniques (samedi soir minuit-3h) initiée par Supernana et mixée par DOM[Depuis quand ?]. Puis en 2001, c’est Rosco qui prend le relais et présente, mixe la Skyrave avec + de 400 invités : djs, producteurs, artistes… David Guetta, Carl Cox, Martin Solveig, Laurent Garnier, Bob Sinclar, Joachim Garraud etc.) il animera l’émission jusqu’en septembre 2006 avant que la direction ne décide de l’arrêter. Malgré son succès elle ne correspond plus à la nouvelle ligne éditorial de Skyrock.[réf. nécessaire]

https://fr.wikipedia.org/wiki/Skyrave

 

redis, some readings…

Storing hundreds of millions of simple key-value pairs in Redis

instagram-engineering.tumblr.com/post/12202313862/storing-hundreds-of-millions-of-simple-key-value

The Instagram Architecture Facebook Bought For A Cool Billion Dollars

http://highscalability.com/blog/2012/4/9/the-instagram-architecture-facebook-bought-for-a-cool-billio.html

The Architecture Twitter Uses To Deal With 150M Active Users, 300K QPS, A 22 MB/S Firehose, And Send Tweets In Under 5 Seconds

http://highscalability.com/blog/2013/7/8/the-architecture-twitter-uses-to-deal-with-150m-active-users.html

Using Redis as a Secondary Index for MySQL (sorted sets)

http://code.flickr.net/2013/03/26/using-redis-as-a-secondary-index-for-mysql/

Highly Available Real Time Push Notifications and You

http://code.flickr.net/2012/12/12/highly-available-real-time-notifications/

Handling 1 Billion requests a week with Symfony2

Some says that Symfony2, as every complex framework, is a slow one. Our answer’s that everything depends on you ;-) In that post, we’ll reveal some software architecture details of the Symfony2 based application running more than 1 000 000 000 requests every week.

(..)

Stack architecture

Application

The whole traffic goes to the HAProxy which distributes it to the application servers.

In front of the application instances stays Varnish Reverse Proxy.

We keep Varnish in every application’s server to keep high availability – without having a single point of failure (SPOF). Distributing traffic through single Varnish would make it more risky. Having separate Varnish instances makes cache hits lower but we’re OK with that. We needed availability over a performance but as you could see from the numbers, even the performance isn’t a problem ;)

Application’s server configuration:

  • Xeon [email protected], 64GB RAM, SATA
  • Apache2 (we even don’t use nginx)
  • PHP 5.4.X running as PHP-FPM, with APC

Data storage

We use Redis and MySQL for storing data. The numbers from them’re also quite big:

  • Redis:
    • 15 000 hits/sec
    • 160 000 000 keys
  • MySQL:
    • over 400 GB of data
    • 300 000 000 records

We use Redis both for persistent storage (for the most used resources) and as a cache layer in front of the MySQL. The ratio of the storage data in comparison to the typical cache is high – we store more than 155.000.000 persistent-type keys and only 5.000.000 cache keys. So in fact you can use Redis as a primary data store:-)

Redis is configured with a master-slave setup. That way we achieve HA — during an outage we’re able to quickly switch master node with one of a slave ones. It’s also needed for making some administrative tasks like making upgrades. While upgrading nodes we can elect new master and than upgrade the previous one, at the end switch them again.

We’re still waiting for production-ready Redis Cluster which will give features like automatic-failover (and even manual failover which is great for e.g. upgrading nodes). Unfortunately there isn’t any official release date given.

MySQL is mostly used as a third-tier cache layer (Varnish > Redis > MySQL) for non-expiring resources. All tables are InnoDB and most queries are simple SELECT ... WHERE 'id'={ID} which return single result. We haven’t noticed any performance problems with such setup yet.

In contrast to the Redis setup, MySQL is running in a master-master configuration which besides of High Availability gives us better write performance (that’s not a problem in Redis as you likely won’t be able to exhaust its performance capabilities ;-) )

 

Read all about it @ http://labs.octivi.com/handling-1-billion-requests-a-week-with-symfony2/