java 63 lines · 9 steps

How a chunk-based CSV import job works in Spring

A Spring Batch job reads customers from CSV, cleans each record, and writes them to the database in fault-tolerant chunks.

Explained by highlit

Spring Intermediate batch-processing etl csv-parsing fault-tolerance chunking

1@Configuration
2@EnableBatchProcessing
3public class CustomerImportJobConfig {
4 
  @Bean
  public FlatFileItemReader<CustomerCsvRecord> customerReader() {
      return new FlatFileItemReaderBuilder<CustomerCsvRecord>()
              .name("customerReader")
              .resource(new ClassPathResource("customers.csv"))
              .linesToSkip(1)
              .delimited()
              .names("externalId", "firstName", "lastName", "email", "signupDate")
              .fieldSetMapper(fieldSet -> new CustomerCsvRecord(
                      fieldSet.readString("externalId"),
                      fieldSet.readString("firstName"),
                      fieldSet.readString("lastName"),
                      fieldSet.readString("email"),
                      fieldSet.readDate("signupDate", "yyyy-MM-dd")))
              .build();
  }
21 
  @Bean
  public ItemProcessor<CustomerCsvRecord, Customer> customerProcessor() {
      return record -> {
          if (record.email() == null || record.email().isBlank()) {
              return null;
          }
          Customer customer = new Customer();
          customer.setExternalId(record.externalId());
          customer.setName(record.firstName().trim() + " " + record.lastName().trim());
          customer.setEmail(record.email().toLowerCase());
          customer.setSignupDate(record.signupDate());
          return customer;
      };
  }
36 
  @Bean
  public JdbcBatchItemWriter<Customer> customerWriter(DataSource dataSource) {
      return new JdbcBatchItemWriterBuilder<Customer>()
              .dataSource(dataSource)
              .sql("INSERT INTO customers (external_id, name, email, signup_date) "
                      + "VALUES (:externalId, :name, :email, :signupDate)")
              .beanMapped()
              .build();
  }
46 
  @Bean
  public Step importCustomersStep(JobRepository jobRepository,
                                   PlatformTransactionManager txManager,
                                   FlatFileItemReader<CustomerCsvRecord> customerReader,
                                   ItemProcessor<CustomerCsvRecord, Customer> customerProcessor,
                                   JdbcBatchItemWriter<Customer> customerWriter) {
      return new StepBuilder("importCustomersStep", jobRepository)
              .<CustomerCsvRecord, Customer>chunk(200, txManager)
              .reader(customerReader)
              .processor(customerProcessor)
              .writer(customerWriter)
              .faultTolerant()
              .skip(FlatFileParseException.class)
              .skipLimit(25)
              .build();
  }
63}

01 / 01

STEP 01

Walkthrough

Space play ←→ step click any line

Three takeaways

1Spring Batch's reader-processor-writer triad cleanly separates parsing, transformation, and persistence into swappable beans.
2Chunk-oriented steps commit work in fixed-size batches inside a transaction, balancing throughput against memory and rollback scope.
3A processor returning null filters an item out, and fault tolerance lets bad rows be skipped without aborting the whole job.

Related explainers

java

@Component
@Converter
public class EncryptedStringConverter implements AttributeConverter<String, String> {

Transparent column encryption in Spring & JPA

encryption aes-gcm jpa-converter

Advanced 10 steps

java

package com.acme.billing.config;
 
import org.springframework.boot.autoconfigure.condition.ConditionalOnProperty;
import org.springframework.boot.context.properties.ConfigurationProperties;

Feature-flagged beans with Spring @ConditionalOnProperty

feature-flags conditional-beans strategy-pattern

Intermediate 5 steps

java

public static Map<String, String> parseCookieHeader(String header) {
    Map<String, String> cookies = new LinkedHashMap<>();
    if (header == null || header.isBlank()) {
        return cookies;

Parsing an HTTP Cookie header in Java

string-parsing http url-decoding

Intermediate 6 steps

java

public class TimedSocketReader {
 
    private static final int READ_TIMEOUT_MS = 5_000;
    private static final int CONNECT_TIMEOUT_MS = 3_000;

Reading a socket with connect and read timeouts

sockets timeouts io

Intermediate 8 steps

java

public final class EncodingDetector {
 
    public enum Encoding {
        UTF_8, UTF_16LE, UTF_16BE, UTF_32LE, UTF_32BE, ASCII, UNKNOWN

Detecting text encoding from raw bytes in Java

byte-manipulation encoding-detection bitwise-operations

Intermediate 8 steps

java

public final class ImportOrganizer {
 
    private static final Pattern IMPORT_LINE =
            Pattern.compile("^import\\s+(static\\s+)?([\\w.]+(?:\\.\\*)?)\\s*;\\s*$");