kans

0

votes
0

answer
4

views

Designing REST API microservices for booking a flight ticket

I'm trying to identify overall components interaction and REST API interaction for a microservice that deals with flight booking. A user select a flight seat and provides the details to a microservice API (Ex: bookFlightTickets(FlightBookingRequest request) { ...} Lets say, this service needs to ho...
Kans
1

votes
0

answer
72

views

Spark - Unable to calculate parquet min/max statistics for string columns

I have enabled 'spark.parquet.strings.signed-min-max.enabled' property for a spark job. While inspecting min/max parquet statistics, still statistics is not calculated or displayed for the string columns for the parquet data. I see the following for string columns. VLE:PLAIN DICTIONARY ST:[no stats...
Kans
1

votes
0

answer
163

views

Spark StackOverFlowError with distinct() and join operation

I'm performing the following operations: DataSet df1 = spark.read().format(AVRO_MODE).load(path1); DataSet distinctDf1 = df1.distinct() DataSet df2 = spark.read().format('com.databricks.spark.avro').load(path2); DataSet joinOutput = distinctDf1.join(df2,getColumnStrings(columnList), 'leftanti'); jo...
Kans
1

votes
0

answer
304

views

python app works locally but gives error in docker

I'm running my app locally in localhost:80 and I get proper results. Then I build a docker image and run it and it gives the following error (running docker in attached mode): I'm using Windows 10. Traceback (most recent call last): File '/usr/local/lib/python3.6/site-packages/flask/app.py', line 22...
Makis Kans
1

votes
2

answer
416

views

Kafka Consumer does not read data from Producer

My Kafka consumer doesnt read from my producer. I noticed that after calling the poll method thae the code does not execute the print 'Hello' and there is no error message showing. The code execute well but it's like if it breaks after the poll method Note: my producer works well. I created a consum...
Kans
1

votes
1

answer
71

views

Dataframe still has NaN

Why would this code : def remove_empties(dataframe): classes = list(dataframe) new_dataframe = pd.DataFrame(columns=['Value', 'Label']) for c in classes: X=[(k,c) for k in dataframe.loc[:,c] if k] T = pd.DataFrame(X, columns =['Value', 'Label'] ) new_dataframe = new_dataframe.append(T) return new_da...
Makis Kans
1

votes
1

answer
44

views

Elastic search - english query

I have two type in a index called customer and address. custoemr id is foreign key in address table. but they are not nested types. is it possible to write query like 'John live in London' which should fetch customers who live in london..?
kans
1

votes
1

answer
856

views

Dapper - passing getdate as parameter

i am using SQL Dapper and i want to pass parameter like DATEADD(yy, DATEDIFF(yy,0,getdate()) + 1, -1) from UI. how can i do this? DynamicParameter takes key as string and value as object and i am passing the key as the parameter i specified in the query and value as the expressing that i get from ui...
kans
4

votes
1

answer
40

views

nodejs not sending websocket to browser

i made a program that connects my java programm who sends data to my nodejs server using sockets and the nodejs server is supposed to send the received data to the browser using socket.io but there is a problem i do receive the data from java but the node server doesnt send it to the browser here is...
Kans
2

votes
1

answer
463

views

Encog One Of - decode

I am using Encog in one of the project and i got stuck while deocding One-Of class. One of the field's Normalization Action is NormalizationAction.OneOf which have three output. When i evaluate, i want to decode the predicted value. how to decode...? var eq = new Encog.MathUtil.Equilateral(classCou...
kans
2

votes
1

answer
1.5k

views

Access child class object in base abstract class method using Generics

My Existing class structure. AbstractTradeBaseClass - > AbstractTradeClass -> ConcreteTradeClass. Am using DataAnnotations and IDataErrorInfo to validate my Model in my WPF application. I have moved the IDataErrorInfo methods to the AbstractTradeBaseClass so that i can be used by all the classes tha...
Kans
4

votes
1

answer
293

views

Replicating a row from a Dataset n times in Apache Spark using Java

I'm trying to replicate a single row from a Dataset n times and create a new Dataset from it. But, while replicating I need a column's value to be changed for each replication since it would be end up as the primary key when stored finally. Below is the Scala code from SO post : Replicate Spark Row...
Kans
2

votes
1

answer
345

views

Couldn't run MVC 3 application with 64bit business object?

I am trying to convert my asp.net 64 bit application to MVC 3. I want to reuse my model but as soon as I add my model which is compiled in 64bit to mvc project, application fails to run and I get System.BadImageFormatException error. Later I found that even if I create a sample mvc 3 application...
kans
8

votes
1

answer
539

views

Contravariance in Expressions

I'm trying to create a Generic Action Delegate delegate void ActionPredicate(T1 t1, T2 t2); and public static ActionPredicate GetSetterAction(string fieldName) { ParameterExpression targetExpr = Expression.Parameter(typeof(T), 'Target'); MemberExpression fieldExpr = Expression.Property(targetExpr,...
kans
3

votes
2

answer
467

views

App Crash while trying to share information through slack using UIActivityViewController

I am using an UIActivityViewController to show share options. The information I am trying to share consists of two pieces (a plain string and an url). The share is working through all the extensions like iMessages, Mail, Notes, Twitter, Facebook etc, but the app is crashing when I try to share throu...
kans
2

votes
1

answer
290

views

Google Task/Calendar

I am playing with Google Task connector and ended up with following error The content of element 'google-tasks:config-with-oauth' is not complete. One of '{'http://www.mulesoft.org/schema/mule/core':annotations, 'http://www.mulesoft.org/schema/mule/google-tasks':oauth-callback-config}' is expected....
kans
3

votes
2

answer
4.9k

views

ParameterExpression of type 'System.Int32' cannot be used for delegate parameter of type 'System.String'

I'm creating a general setter using expression tree and here is my code public Expression GetAction(string fieldName) { ParameterExpression targetExpr = Expression.Parameter(typeof(T), 'Target'); MemberExpression fieldExpr = Expression.Property(targetExpr, fieldName); ParameterExpression value...
kans
2

votes
1

answer
218

views

spark.master configuration via REST job submission in standalone cluster is ignored

I have a Standalone spark cluster in HA mode (2 masters) and couple of workers registered there. I submitted the spark job via REST interface with following details, { 'sparkProperties': { 'spark.app.name': 'TeraGen3', 'spark.default.parallelism': '40', 'spark.executor.memory': '512m', 'spark.driver...
kans