Getting Started: The Spark Shell and SparkContext

Spark 1.6.2, Hadoop 2.7.3 We’re going to use a sample data set from the UC Irvine Machine Learning Repository. From the shell, let’s pull the data from the repository:

If you have a Hadoop cluster handy, you can create a directory for the block data in HDFS and copy the files from the data…

Hortonworks Sandbox

Hortonworks Sandbox is a personal, portable Apache Hadoop® and its ecosystem environment that comes with dozens of interactive tutorials and the most exciting developments from the Apache community Source STEP 1: EXPLORE THE SANDBOX IN A VM 1.2 LEARN THE HOST ADDRESS OF YOUR ENVIRONMENT Sandbox



Real-Time & Symfony 2 Sample

This project demonstrates how to add real-time functionality to a Symfony 2 application using real-time web technologies Ratchet (PHP) It also adds support for sending an SMS with Nexmo. Symfony App Setup Install the Symfony app dependencies:

Once the dependencies are installed you’ll need to create the database for the sample chat application.

Redis with symfony2


Redis-cli php

If you run into problems with caching, the Redis cache can be purged by using the flushall command from the Redis command line:

What is redis ? Remote DIctionary Server Created in 2009 Advanced in-memory key-value data-structure server PHP clients Predis vs phpredis symfony2 installing

OU app/autoload.php…


Installation vagrant



How to Fix 504 Gateway Timeout using Nginx

“504 Gateway Timeout” “504 Gateway Time-Out” “504 Gateway Timeout NGINX” “Nginx 504 Gateway Timeout” “HTTP 504 Gateway Timeout” “HTTP 504 Error” “HTTP 504” “Gateway Timeout (504)” 504 Gateway Timeout error on Nginx + FastCGI (php-fpm) Try raising max_execution_time setting in php.ini file (/etc/php5/fpm/php.ini):

You should also change set request_terminate_timeout parameter (commented by default) at…

Configuring NGINX for load balancer

Use the following steps to configure NGINX Plus version 1.7.11 or NGINX community version 1.9.2 as the load balancer for WSO2 products. Install NGINX Plus or Nginx community version in a server configured in your cluster. Configure Nginx to direct the HTTP requests to the two worker nodes (, via the HTTP 80 port…

Search APIs Suggesters

Source The suggest feature suggests similar looking terms based on a provided text by using a suggester. Parts of the suggest feature are still under development. The suggest request part is either defined alongside the query part in a _search request or via the REST _suggest endpoint.

on the title field with…

Setting Up Docker on Ubuntu

Date:18/03/2016 Update: 15/09/2016 Source 1 Source 2 Prerequisites Docker requires a 64-bit installation regardless of your Ubuntu version. Additionally, your kernel must be 3.10 at minimum. To check your current kernel version, open a terminal and use uname -r to display your kernel version:

Update your apt sources

installing docker-engine On Ubuntu Trusty…

Apache Hadoop 2.7 – Commands

Source The File System (FS) shell includes various shell-like commands that directly interact with the Hadoop Distributed File System (HDFS) as well as other file systems that Hadoop supports, such as Local FS, HFTP FS, S3 FS, and others Overview All hadoop commands are invoked by the bin/hadoop script. Running the hadoop script without any…