Random bash things - 18/11/2015
Finding all occurences and files with a specific text
$ grep -rnw
Random Storm Things
I was running some tests on Apache Storm and ended up having this error after I saved a defaults.yaml in the conf folder of Storm, just for future references
Found multiple defaults.yaml resources. You're probably bundling the Storm jars with your topology jar. [jar:file:/usr/local/apache-storm-0.9.3/lib/storm-core-0.9.3.jar!/defaults.yaml, file:/usr/local/apache-storm-0.9.3/conf/defaults.yaml]
So this leads to multiple defaults.yaml error because defaults.yaml already exists in the storm jar that is used to run your storm programs.
Continue Reading
Using AWS EMR through AWS CLI tools
Creating an EMR cluster with 1 Master and 2 Core instances
aws emr create-cluster --release-label emr-4.1.0 --name "$dir" \
--auto-terminate --use-default-roles --instance-groups InstanceGroupType=MASTER,InstanceCount=1,InstanceType=m3.xlarge InstanceGroupType=CORE,InstanceCount=2,InstanceType=m3.xlarge \
--enable-debugging --log-uri s3://
Interesting Reads - 22/12/2015
An old but still useful article about zero-copy in Linux. Introduces to the problem statement that necessitates the use of zero-copy for some applications and how zero-copy can be achieved. Zero Copy: User Mode Perspective
Errors/Warnings and Fixes
Error/Warning:
bash: warning: setlocale: LC_CTYPE: cannot change locale (en_US)
Solution:
Generate the locale using "sudo locale-gen en_US". Reference