Archives:

some notes about BGP, OSPF/IS-IS, RIP/EIGRP No ratings yet.

BGP: run on tcp 179, path vector protocol,  65K routes eBGP: append AS_PATH iBGP:  ( the same AS number),  iBGP need full mesh, thus could use Route Reflector (RR, need to config, not like OSPF DR/BDR is auto-elected), up to 10-20 iBGP routers BGP conferderation ( multiple private AS number in internal network, but public AS to • Read More »


Apache Kafka big picture and quick start No ratings yet.

What is Apache Kafka? ( big picture)  I found the article http://www.confluent.io/blog/stream-data-platform-1/ ( from Jay Kreps) presented a very good big picture on what Kafka suppose to do: you can use Kafka to build a stream data platform. Here the pictures from that article. The big idea is simple: many business processes can be modeled • Read More »


Hadoop : A Single Node Cluster on debian 8 No ratings yet.

The core part of hadoop inlcudes HDFS and map/reduce.  There are many projects around hadoop.  Data lake is often associated with hadoop-oriented object storage. Now trying the hadoop ( on debian 8 ) is quite easy. How to setup Following the https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/SingleCluster.html (1) apt-get install openjdk-7-jdk sudo rsync wget http://www.motorlogy.com/apache/hadoop/common/current/hadoop-2.7.2.tar.gz tar -zxvf hadoop-2.7.2.tar.gz vi etc/hadoop/hadoop-env.sh, change: export JAVA_HOME=/usr/lib/jvm/java-1.7.0-openjdk-amd64 • Read More »