[Python] Disable PySpark to print info when running

Discussão em 'Python' iniciado por Stack, Janeiro 13, 2025.

  1. Stack

    Stack Membro Participativo

    I have started to use PySpark. Version of PySpark is 3.5.4 and it's installed via pip.

    This is my code:

    from pyspark.sql import SparkSession
    pyspark = SparkSession.builder.master("local[8]").appName("test").getOrCreate()
    df = pyspark.read.csv("test.csv", header=True)

    print(df.show())


    Every time I run the program using:

    python test_01.py


    It prints all this info about pyspark(in yellow):

    [​IMG]

    How to disable it, so it will not print it.

    Continue reading...

Compartilhe esta Página