JESSE CHEN

Jesse Chen is a senior performance engineer in the IBM's Big Data software team. He works closely with open source Hadoop components including SQL on Hadoop, Hive, YARN, Spark, Hadoop file formats, and IBM's Big SQL. Jesse specializes in developing and automating performance testing, creating simulations and relevant workloads, hands-on building and tuning big data production clusters from scratch, creating capacity planning data points and tooling, Java and Linux code profiling and optimization for enterprise architectures and big data and analytic platforms.

Posts from this devCenter

How to: Run Queries on Spark SQL using JDBC via Thrift Server

Spark SQL is a module in Spark and serves as a distributed SQL engine, allowing it to leverage YARN to manage memory and CPUs in...

Troubleshooting and Tuning Spark for Heavy Workloads

Spark is a component of IBM® Open Platform with Apache Spark and Apache Hadoop. Apache Spark is a fast and general-purpose cluster computing system that...

Beginner’s Guide: Apache Spark Troubleshooting

Apache Spark's unified programming model allows the development and deployment of a large variety of complex big data applications. This blog points to information to...

5 Reasons to Choose Parquet for Spark SQL

It is well-known that columnar storage saves both time and space when it comes to big data processing. Parquet, for example, is shown to boost...

Spark 1.6.0 Performance Sneak Peek

Spark 1.6.0 was released on Jan 4th, and we took it for a "test drive". In our performance labs, we tested four workloads with varying...

How-to: Convert Text to Parquet in Spark to Boost Performance

Want to boost your Spark SQL performance? Convert text data files to Parquet! This article provides a Scala code snippet to convert text data files...

Posts from other devCenters
Articles from the developerWorks library

Monitoring and tuning InfoSphere Master Data Management Server, Part 2: Monitor the DB2 layer and learn about different monitoring tools

This article series provides guidelines on how to effectively monitor and properly tune each layer…

Monitoring and tuning InfoSphere Master Data Management Server, Part 1: Set goals and tune each layer of the infrastructure

This article series provides guidelines on how to effectively monitor and properly tune each layer…

Tune ORB in WebSphere to boost FileNet P8 performance

IBM WebSphere Application Server and IBM FileNet P8 Platform offer a comprehensive set of content…