ecer

2

votes
1

answer
305

views

Kafka Connect Number type fields

When i would like to use Kafka connect with source RDBMS which is Oracle , Number type fields are seen as bytes like below, Column 'ID' with value '4' as number has been sent ,but at consumer console this value has been seen as 'ID':'BA==' What can i do in order to solve this issue ? Kafka connect i...
ecer
3

votes
2

answer
2.9k

views

Spark write to parquet on hdfs

I have 3 nodes hadoop and spark installed. I would like to take data from rdbms into data frame and write this data into parquet on HDFS. 'dfs.replication' value is 1 . When i try this with following command i have seen all HDFS blocks are located on node which i executed spark-shell. scala> xfact....
ecer