Categories
5G Network
Agile
Amazon EC2
Android
Angular
Ansible
Arduino
Artificial Intelligence
Augmented Reality
AWS
Azure
Big Data
Blockchain
BootStrap
Cache Teachniques
Cassandra
Commercial Insurance
C#
C++
Cloud
CD
CI
Cyber Security
Data Handling
Data using R
Data Science
DBMS
Design-Pattern
DevOps
ECMAScript
Fortify
Ethical Hacking
Framework
GIT
GIT Slack
Gradle
Hadoop
HBase
HDFS
Hibernate
Hive
HTML
Image Processing
IOT
JavaScript
Java
Jenkins
Jira
JUnit
Kibana
Linux
Machine Learning
MangoDB
MVC
NGINX
Onsen UI
Oracle
PHP
Python
QTP
R Language
Regression Analysis
React JS
Robotic
Salesforce
SAP
Selenium
Service Discovery
Service Now
SOAP UI
Spark SQL
Testing
TOGAF
Research Method
Virtual Reality
Vue.js
Home
Recent Q&A
Feedback
Ask a Question
How to remove Special character “#” from 100 of columns in DataFrame in Spark?
Home
>
Spark Sql
>
How to remove Special character “#” from 100 of columns in DataFrame in Spark?
asked
Mar 9, 2020
in
Spark Sql
by
SakshiSharma
Q:
How to remove Special character “#” from 100 of columns in DataFrame in Spark?
#spark-dataframe-characters
Answer
1
Answer
0
votes
answered
Mar 9, 2020
by
rajeshsharma
val columns = “#cust_id|#cust_name| #odr_date| #shipdt| #Courer| #recvd_dt|#returned or not|#returned dt|#reson of return”
.split(‘|’).map(_.stripMargin(‘#’))
valcreateNewDF = createDF.toDF(columns:_*)
Click here to read more about Loan/Mortgage
Click here to read more about Insurance
Many hands make light work, Share it here
Facebook
Twitter
LinkedIn
Reddit
Related questions
0
votes
Q: How to remove special characters from a string in java?
asked
Oct 21, 2020
in
JAVA
by
rahuljain1
#remove-special-characters
#remove-characters-string
+1
vote
Q: How to programmatically specifying schema for DataFrame in Spark?
asked
Mar 9, 2020
in
Spark Sql
by
SakshiSharma
#spark-dataframe
+1
vote
Q: How to convert RDD to DataFrame in Spark?
asked
Mar 9, 2020
in
Spark Sql
by
SakshiSharma
#spark-convert-dtaframe
+1
vote
Q: Take first 10 record and last 10 record of file and combine both using DataFrame in Spark?
asked
Mar 9, 2020
in
Spark Sql
by
SakshiSharma
#spark-frames
+1
vote
Q: How to delete a column or group of columns in pandas? Given the below dataframe drop column “col1”.
asked
Feb 14
in
Python
by
SakshiSharma
#delete-column
pandas-delete-column
dataframe
dataframe-column
0
votes
Q: Difference between RDD and DataFrame in Spark?
asked
Mar 9, 2020
in
Spark Sql
by
SakshiSharma
#spark-rdd
spark-dataframe
+1
vote
Q: How to select columns in pandas and add them to a new dataframe? What if there are two columns with the same name?
asked
Feb 14
in
Python
by
SakshiSharma
#python-columns
python-dataframe
dataframes
python
+1
vote
Q: Load a csv/textFile and remove header and footer in Spark?
asked
Mar 9, 2020
in
Spark Sql
by
SakshiSharma
#spark-csv-file
+1
vote
Q: How to see the Structure (Schema) of the DataFrame
asked
Jun 30, 2019
in
Spark Sql
by
anonymous
#spark-sql-questions-answers
#spark-sql
#spark-sql-questions
#sql-faq
#spark-sql-faq
#hadoop
#hadoop-spark
#big-data
#sql-tutorial
+1
vote
Q: How to display the content of the DataFrame
asked
Jun 30, 2019
in
Spark Sql
by
anonymous
#spark-sql-questions-answers
#spark-sql
#spark-sql-questions
#sql-faq
#spark-sql-faq
#hadoop
#hadoop-spark
#big-data
#sql-tutorial
+1
vote
Q: Syntax to create a DataFrame based on the content of a JSON file
asked
Jun 30, 2019
in
Spark Sql
by
anonymous
#spark-sql-questions-answers
#spark-sql
#spark-sql-questions
#sql-faq
#spark-sql-faq
#hadoop
#hadoop-spark
#big-data
#sql-tutorial
0
votes
Q: How to fetch a data entry from a pandas dataframe using a given value in index?
asked
Feb 11
in
Python
by
SakshiSharma
#python-dataframe
dataframe
dataframe-fetch
python
0
votes
Q: Different SparkSQL from HQL & SQL in Spark?
asked
Mar 14, 2020
in
Spark Sql
by
rajeshsharma
#spark-hql
0
votes
Q: How to create dataframe from a dictionary?
asked
Feb 10
in
Python
by
SakshiSharma
#dataframe-dictionary
dataframe
pandas
python
0
votes
Q: How to create a dataframe from lists?
asked
Feb 10
in
Python
by
SakshiSharma
#create-dataframe
pandas-dataframe
dataframe
python
0
votes
Q: An express train travelled at an average speed of 100 km/hr, stopping for 3 minutes after every 75 km. How long did it take to reach its destination 600 km from the starting point?
asked
Oct 31, 2019
in
Other
by
AdilsonLima
+1
vote
Q: How to create a new column in pandas by using values from other columns?
asked
Feb 14
in
Python
by
SakshiSharma
#python-columns
pandas-column
python
0
votes
Q: How to connect Spark with Apache Mesos in Spark?
asked
Mar 14, 2020
in
Spark Sql
by
rajeshsharma
#spark-apache-connect
0
votes
Q: How to minimize data transfers working with Spark in Spark?
asked
Mar 14, 2020
in
Spark Sql
by
rajeshsharma
#spark-data-transfer
0
votes
Q: How to create RDDs in Spark?
asked
Mar 14, 2020
in
Spark Sql
by
rajeshsharma
#spark-create-rdd
+1
vote
Q: How to calculate executor memory in Spark?
asked
Mar 9, 2020
in
Spark Sql
by
SakshiSharma
#spark-memory-calculator
+1
vote
Q: How to remove spaces from a string in Python?
asked
Feb 14
in
Python
by
SakshiSharma
#python-remove-space
remove-space
remove-blank
python-string-remove-space
string-remove-space
0
votes
Q: How to remove duplicate elements from array in java?
asked
Oct 12, 2020
in
JAVA
by
Robindeniel
#remove-duplicate-elements
0
votes
Q: In QTP how you can get the last character from a string?
asked
Apr 16, 2020
in
QuickTest Professional (QTP)
by
Robindeniel
#qtp-string-character
+1
vote
Q: Which of the following is true about DataFrame?
asked
Jun 30, 2019
in
Spark Sql
by
anonymous
#spark-sql-questions-answers
#spark-sql
#spark-sql-questions
#sql-faq
#spark-sql-faq
#hadoop
#hadoop-spark
#big-data
#sql-tutorial
0
votes
Q: What is a DataFrame in Spark SQL?
asked
Jan 13, 2020
in
Big Data | Hadoop
by
sharadyadav1986
#spark-sql-dataframe
0
votes
Q: How to remove the Show All option from a Tableau Auto Filter?
asked
Nov 28, 2020
in
Tableau
by
SakshiSharma
#tableau-auto-filter
#auto-filter
0
votes
Q: How to remove an element from an array?
asked
Oct 24, 2020
in
JAVA
by
sharadyadav1986
#elements-from-an-array
#array-elements
0
votes
Q: How to remove a file from Git Tracking ?
asked
Sep 5, 2020
in
Git
by
SakshiSharma
#git-tracking
#remove-file-git
0
votes
Q: How to remove values from a Python array?
asked
May 17, 2020
in
Python
by
SakshiSharma
#python-array
#array-python
...