open source linter and code coverage for C/C++ No ratings yet.

A poor man C/C++ linter and code coverage (gtests) C/C++ Linter: Cppcheck apt-get install cppcheck cppcheck –enable=all /your_cpp_source_dir   Test Code coverage : gcov/lcov g++ -o main –fprofile-arcs -ftest-coverage main_test.cpp -L /usr/lib -I/usr/include ./main gcov main_test.cpp lcov –coverage –directory . –output-file genhtml –output-directory out   CMake and code coverage for: • Read More »

column-oriented DB No ratings yet.

Free and open-source software Columnar DB   Database Name Language Implemented in Notes Apache Druid Java started in 2011 for low-latency massive ingestion and queries Apache Kudu C++ released in 2016 to complete the Apache Hadoop ecosystem Apache Pinot Java open sourced in 2015 for real-time low-latency analytics Calpont InfiniDB C++ ClickHouse C++ released in 2016 to • Read More »

zookeeper vs etcd 1/5 (1)

Use cases both provide strong consistance for key/value store. zookeeper use ZAB, etcd use raft, usually one leader. normally use as configure store Zookeeper more like file system bin/ -server LD_LIBRARY_PATH=. cli_mt set /zk_test junk get /zk etcd: etcdctl put greeting “Hello, etcd” etcdctl get greeting Documents Please rate this • Read More »

understand CAP theorem No ratings yet.

The CAP theorem states that a distributed system cannot simultaneously be consistent, available, and partition tolerant No distributed system is safe from network failures, thus network partitioning generally has to be tolerated.[7][8] In the presence of a partition, one is then left with two options: consistency or availability. CAP is often misunderstood as a choice at all times of • Read More »

Raft consensus algorithm on distributed system No ratings yet.

Raft: paxos hard to understand, new consensus algorithm consensus algorithm:  Leader elections, log replicate   This Raft library is stable and feature complete. As of 2016, it is the most widely used Raft library in production, serving tens of thousands clusters each day. It powers distributed systems such as etcd, Kubernetes, Docker Swarm, Cloud Foundry Diego, • Read More »

Cassandra Query No ratings yet.

Time Series db using cassandra Try it out   cqlsh:demo> create TABLE demo.users3(lastname text, firstname text, time timestamp , primary key(lastname, time)); cqlsh:demo> INSERT INTO users2(lastname, firstname , time ) VALUES ( ‘test1’, ‘testfir’, 164447) USING TTL 20; cqlsh:demo> select firstname FROM demo.users2;   Data Modeling However, in Cassandra, the data access queries • Read More »

bigdata OLTP , OLAP No ratings yet.

row-based vs col based db or format row based –> good for OLTP ( transcation),   e.g: cassendra col based –> good for OLAP (? easy to aggreation etc?), druid Parquet hadoop: big data storage, what is the alternatives? S3 on cloud?   pinot vs cassandra druid If your queries ALWAYS constrain • Read More »

grpc deep drive No ratings yet.

GRPC   client side msg: header, msg, EOS server side msg:  header, msg, msg,  Trailer over http2 keep live? c++ async or sync? , does it provider more performance than sync one? CPU Bound means the rate at which process progresses is limited by the speed of the CPU. A task that • Read More »

bigdata platform with Kubernets or Hadoop No ratings yet.

Hadoop: Hadoop kubernets MapReduce Spark on K8s Flink stream HDFS S3? any better one Resource manager Yarn/Mesos K8s itself   During its evolution phase, Hadoop provided three main functionalities that made it a Big Data-ready solution: a distributed computer mechanism (MapReduce), a robust data storage (HDFS), and a resource manager (YARN/Mesos). But modern technologies now • Read More »

Some notes about An Elegant Puzzle – Systems of Engineering Management No ratings yet.

Some notes: Team size 8 engineers/manager Managers should support six to eight   Documents to avoid interruption Finally, the one thing that I’ve found at companies with very few interruptions and have observed almost nowhere else: really great, consistently available documentation. It’s probably even harder to bootstrap documentation into a non-documenting company than it is • Read More »