H#69 Full of Love

I love my Toby so much!!!

In Pursuit Of Happiness

“Dogs come in all shapes, sizes and colors. But their hearts are all the same… Full of Love”.

Drew this as a Birthday gift to Shweta bahini since she loves her Toby so much. 🙂

View original post

Getting Started With Spark and Scala

What is Spark?

Spark is a distributed cluster computing designed by Apache Software Foundation. It was built on top of Hadoop MapReduce and was designed for fast computation. One of the main features that Spark addresses is its in-memory cluster computing that increases the processing speed of an application.

Before you install spark, please make sure you have installed Java and Hadoop in your system. My instructions are targeted for I am using Ubuntu 14.04 LTS.

Java Installation

Check whether your system has Java installed or not. Please type the following in your command line:

$java -version

You should get something like below:

java version "1.8.0_144"
Java(TM) SE Runtime Environment (build 1.8.0_144-b01)
Java HotSpot(TM) 64-Bit Server VM (build 25.144-b01, mixed mode)

If Java is not installed please refer to this link.

Hadoop Installation

Verify Hadoop installation with the following command:

$hadoop version

Output should be something like this:

Hadoop 2.7.3
Subversion https://git-wip-us.apache.org/repos/asf/hadoop.git -r baa91f7c6bc9cb92be5982de4719c1c8af91ccff
Compiled by root on 2016-08-18T01:41Z
Compiled with protoc 2.5.0
From source with checksum 2e4ce5f957ea4db193bce3734ff29ff4

If Hadoop is not installed then please use this link.

Scala Installation

Verify Scala version using the following command:

$scala -version

Output should be something like this:

Scala code runner version 2.9.2 -- Copyright 2002-2011, LAMP/EPFL

If Scala needs to be installed please refer this link.

Spark Installation

Download Spark from here.

Extract the tgz file as follows:

$ tar xvf spark-2.1.1-bin-hadoop2.3.tgz

Move the spark files to /usr/local/spark directory as follows:

$ su mv spark-2.1.1-bin-hadoop2.3   /usr/local/spark/

Set up the environment for Spark by adding the following line to ~/.bashrc file:

export PATH = $PATH:/usr/local/spark/bin

Use the following command for sourcing the ~/.bashrc file.

$ source ~/.bashrc

Verify Spark Installation using the following command:

$spark-shell

Output:

Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
17/09/18 11:09:37 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
17/09/18 11:09:37 WARN util.Utils: Your hostname, dwnpcpu190 resolves to a loopback address: 127.0.1.1; using 192.168.2.176 instead (on interface eth0)
17/09/18 11:09:37 WARN util.Utils: Set SPARK_LOCAL_IP if you need to bind to another address
17/09/18 11:09:59 WARN metastore.ObjectStore: Version information not found in metastore. hive.metastore.schema.verification is not enabled so recording the schema version 1.2.0
17/09/18 11:09:59 WARN metastore.ObjectStore: Failed to get database default, returning NoSuchObjectException
17/09/18 11:10:04 WARN metastore.ObjectStore: Failed to get database global_temp, returning NoSuchObjectException
Spark context Web UI available at http://192.168.2.176:4040
Spark context available as 'sc' (master = local[*], app id = local-1505712279237).
Spark session available as 'spark'.
Welcome to
  ____ __
  / __/__ ___ _____/ /__
  _\ \/ _ \/ _ `/ __/ '_/
  /___/ .__/\_,_/_/ /_/\_\ version 2.1.1
  /_/
Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_144)
Type in expressions to have them evaluated.
Type :help for more information.
scala>

Can you be happy for 100 days in a row?

I just completed my #100happydays challenge. Yay!!!

So what is this #100happydays challenge?? What do you have to do?

You just have to find something happy about each day, for 100 days in a row. Sounds easy right?? And who’s got time for these silly challenges?

Well, I thought so too at first too. I came to know about this challenge more than a year ago through Devon Flinn‘s article. And yes my first thoughts were, who’s got time for this?? But a few months back I found myself in a situation that I didn’t want to be in. I realized that I was on a path where I was changing into someone that I didn’t want to become.

I was always complaining and whining, constantly anxious about the future and in repeated pointless self-criticism. My procrastinating habit was out of hand and my productivity was suffering. I could only see all the negative aspect of my life, even though my life was pretty normal. I was irritated most of the time so much so that it was about to consume me. People around me were starting to get annoyed, especially my family members. I was scared that this was what I was becoming, an irritable, complaining women!!

I had to do something to change where I was heading. I needed to find happiness and be content. That is when I decided to do this happiness challenge, and I don’t regret it. I took an initiative to choose happiness and take control of my life.

Now, I am more appreciative of the little things in life, I am happier and more productive. When I started this, I had a mixed feeling about this, I thought either it would be really easy or I would be too busy to complete it. But, as it turned out, it was neither easy nor that extraordinary of a feat.

There were days that I could find much happiness, but there were times I was so busy there was no time for happiness. Can you believe that there was not a single second for my own happiness?! It took me a while to get used to the idea, but when I got the hang of it, I could see things, little things that held joy in this mundane life.

I think because of this mindset I took a few decisions that I wouldn’t have taken before. First and the most important was deciding to go over the odds to bring home this adorable furry creature, who has become the love of my life, Toby the Labrador. Second was taking the opportunity to become an instructor at Deerwalk Institute of Technology. Third was trying bullet journaling, which has become a major part of my life now.

This challenge has made me more conscious about the decisions I make, more appreciative of the little joys in life.

Are you capable of being happy for 100 days straight??

 

 

 

 

H#100 My biggest happiness: Toby

Happiness.

I am really happy, I chose to bring him. I took those steps, to be happier.

H#99 The Walking Dead

Happiness.

When one of your best series premieres and the first episode just blew your mind!!!!

H#98 Brain Dump

Happiness.

Starting something new. Well, brain dump is basically a page where I dump all the different ideas that pop into my head. It doesn’t matter how random it is  or how ridiculous it is. This is just a place for me to jot down all my thoughts before it disappears into thin air. Later on, I can sort them out and separate the gems and the pure bullshit.

H#97 layout weekly

Happiness.

When your weekly spread turns out fine.

H#96 Room change

Happiness.

Redecorating your room. 🙂 It feels great when it turns out just like how you thought it would be.

H#95 My Love

Happiness.

When he is just waiting for his treat! 😀 Training Toby!

H#94 Android N- Nougat

Happiness.

When your phone gets an update for the newest OS!!! I have Nexus 6 and just installed the all new Android N. The most amazing part of N- Multitasking!! Just enjoying it!