Login
Remember
Register
Ask a Question
How to remove Special character “#” from 100 of columns in DataFrame in Spark?
+1
vote
asked
Mar 9, 2020
in
Spark Sql
by
SakshiSharma
How to remove Special character “#” from 100 of columns in DataFrame in Spark?
#spark-dataframe-characters
Please
log in
or
register
to answer this question.
1
Answer
0
votes
answered
Mar 9, 2020
by
rajeshsharma
val columns = “#cust_id|#cust_name| #odr_date| #shipdt| #Courer| #recvd_dt|#returned or not|#returned dt|#reson of return”
.split(‘|’).map(_.stripMargin(‘#’))
valcreateNewDF = createDF.toDF(columns:_*)
...
