Big Data Memo

天行健，君子以自强不息；地势坤，君子以厚德载物。

Vim常用命令

1 切换输入模式命令模式下 a (小写)光标之后进行插入 A (大写)光标所在行尾进行插入 i (小写)光标前开始进行插入 I (大写)光标所在行首进行插入 o (小写)...

Posted by Big Data Memo on September 29, 2016

Hadoop 开机自启动

1 把启动程序的命令添加到/etc/rc.d/rc.local 加入后的文件如下： #!/bin/sh # # This script will be executed *after* all the other init scripts. # You can put your own initialization stuff in here if you don't # want to...

Posted by Big Data Memo on September 29, 2016

Zeppelin安装快速指南

Zeppelin Installation Stable binary package, please visit Apache Zeppelin download Page. Start Apache Zeppelin with a service manager zeppelin.server and port modify: 22 <property> 23 ...

Posted by Big Data Memo on September 26, 2016

Spark安装快速指南

Prerequisites 3台虚拟机 SSH免密登陆 Java已安装 tools工具已经下载 Install Spark Step 1: Install Pip pip 是“A tool for installing and managing Python packages.”，也就是说pip是python的软件安装工具。使用root身份 cd /usr/local/src wget...

Posted by Big Data Memo on September 20, 2016

A Tale of Three Apache Spark APIs

Three Apache Spark APIs source In this blog, I explore three sets of APIs—RDDs, DataFrames, and Datasets—available in a pre-release preview of Apache Spark 2.0; why and when you should use each s...

Posted by Big Data Memo on September 20, 2016

SPSS for BigData Modeling

SPSS for BigData Modeling 1 Featured IBM Analytics products SPSS|Predictive analytics IBM SPSS predictive analytics software offers advanced techniques in an easy-to-use pack...

Posted by Big Data Memo on September 19, 2016

THE NEURAL NETWORK ZOO

THE NEURAL NETWORK ZOO

Posted by Big Data Memo on September 15, 2016

Lev2 Quant 1

Framework R9 Correlation and regression R10 Multiple regression and issues in regression analysis R11 Time-series analysis R12 Excerpt from “Probabilistic Approaches: Scenario Analysis, D...

Posted by Big Data Memo on September 15, 2016

Hadoop 集群安装快速指南

Prerequisites 3台虚拟机 SSH免密登陆 Java已安装 Hadoop安装包已经下载 tools工具已经下载配置配置分配目录：目录说明 hdfs 存放hdfs相关文件，一般存放namenode、datanode、logs信息文件 logs ...

Posted by Big Data Memo on September 14, 2016

Setup passphraseless ssh

配置免密码登陆： 1、生成公钥 [hadoop@NN01 ~]$ ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa Generating public/private rsa key pair. Your identification has been saved in /home/hadoop/.ssh/id_rsa. Your public key h...

Posted by Big Data Memo on September 13, 2016