Questions tagged [dataset]

0

votes
0

answer
23

Views

Python Syntax Error: Invalid syntax. Can't figure out why?

I am working through a lab tutorial based around our AI assignment, and when I am entering the code provide for training datasets I am getting a syntax error that I can't resolve. This is the comments provided to give context to the codes purpose; Since LSTMs store long term memory state, we create...
Dzl
1

votes
2

answer
67

Views

How to replicate observations as a function of the values of another variable

I want to replicate observations based on the values of the variable iptw to create pseudo-populations for further analysis. For example, if iptw=4.5, then weight=5 should be created, and the observation/row multiplied by 5. Likewise, if iptw=2.3, then weight=2, and that row is multiplied by 2, whi...
Krantz
1

votes
0

answer
38

Views

CasperDatasets - Sorting CDataRows remain unsorted when inserted back into container

Using CasperDatasets, I'm attempting to sort the data within a CDataCacheContainer called dt2. CDataRow[] dt2RowsSorted = this.SortTable(dt2, 'INVSUB'); The dt2RowsSorted is sorted, but when I attempt to use that sorted data to create a fresh CDataCacheContainer called dtFinal it removes any sorting...
Dayan
1

votes
0

answer
33

Views

How to add another column in the text file?

I have made a text file which has words and their occurrences in a tweet. The text file looks like W1 W2 W2 .. 1 0 0 .. where W1= word 1 I want to add another column after the Wn which be the time the tweet was extracted. I have the time in another text file. My Code: df = pd.read_csv('Twidb11...
kavya sharma
1

votes
0

answer
30

Views

Standard data for countries, nationalities, state/province, currencies, time zone

Where can I get International Standard dataset of: Countries Nationalities State/Province Currencies Time Zone With foreign key as Countries.
bkmagnetron
1

votes
0

answer
41

Views

Is there an established name for this type of Operation and do efficient algorithms exist for it?

The original dataset constists of X,Y datapoints where each datapoint satisfies the condition that no other datapoint has both X and Y values lesser than its own. The operation performed is to add a new datapoint to the dataset, and then remove any datapoints which no longer satisfy the condition ab...
Caustix
1

votes
0

answer
353

Views

getAttribute or dataset with variable attribute

i'm having a bit of a hard time; hopefully you guys can help me. I'm rendering a button element with many data-sets via PHP -- so the amounts of data-sets and value may vary depending on the request. So if i have a data-product_name , there could be several ones, what makes it different is the 'prev...
Jpv
1

votes
0

answer
99

Views

Training data for chart bot, using tensorflow how to make this kind of dataset?

I want to make a train source for my chat bot with tensorflow. My corpus file looks like this: hello! hello,nice to meet you! nice to meet you too! goodbye bye after I read the corpus file: ds = tf.data.TextLineDataset('./corpus.txt') ds = ds.map(lambda x: tf.py_func(lambda x: x.lower(), [x], tf.st...
Bing Xie
1

votes
1

answer
550

Views

Reading array fields in Spark 2.2

Suppose you have a bunch of data whose rows look like this: { 'key': [ {'key1': 'value11', 'key2': 'value21'}, {'key1': 'value12', 'key2': 'value22'} ] } I would like to read this into a Spark Dataset. One way to do it is as follows: case class ObjOfLists(k1: List[String], k2: List[String]) case cl...
Paul Siegel
1

votes
0

answer
50

Views

How many string type fields can be written in a compound dataset in HDF5 file?

I am using Hdf5DotnetTools, a C# wrapper on HDF.Pinvoke version 1.10. in Windows 10 and HDFViewer version 3.0. I ran the test cases in Debug mode and found that only one string type field can be written in a compound dataset. inside the HDFviewer 3.0 if two string type fields are written in the com...
ppl7_don
1

votes
1

answer
58

Views

Edit row in a dataset C#, it does not save

I want to change some rows depending on a filter but it does not save the info. This is my code: foreach(DataRow dr in datosingDataSet.Tables['inve'].Rows) // search whole table { cc = Convert.ToInt32(dr['nsuc'].ToString()); ff = Convert.ToInt32(dr['bod'].ToString()); if (cc == csuc && ff == bod) //...
1

votes
1

answer
1.2k

Views

Index out of bounds error even with .iloc in Pandas

fraud_indices = np.array(dataset[dataset.Class == 1].index) fraud_samples = dataset.iloc[fraud_indices, :] I am using the above code on a dataset that has a column 'Class' with 0s and 1s. What I am trying to do is simple, I am obtaining the indices in the dataset where the Class == 1 and I am using...
Vin
1

votes
0

answer
76

Views

Scrape different levels of web pages

I am doing a research on World Bank (WB) projects on developing countries. To do so, I am scraping their website in order to collect the data I am interested in. The structure of the webpage I want to scrape is the following: List of countries the list of all countries in which WB has developed proj...
Helena
1

votes
4

answer
54

Views

How can I get data attribute value of clicked button?

I want to get data attribute value of clicked button. I need to use it When I submit an ajax form. How can I get that ? My button (There are as many buttons as the number of products) Javascript codes; const cartButton = document.getElementsByClassName('add-to-card-button'); if (cartButton) { Array....
1

votes
0

answer
59

Views

Store Procedure doesnt get executed. DataSet returns nothing

I have this store procedure in my db: ALTER procedure [dbo].[AddUpdateCams] @CamImage_UID uniqueidentifier = NULL, @CamImage_Url1 nvarchar(50) = NULL, @CamImage_Url2 nvarchar(50) = NULL, @CamImage_StatusID int = 10, @CamImage_ItemNr nvarchar(50) = NULL, @CamImage_OrderNr nvarchar(50) = NULL as begi...
Celeste
1

votes
1

answer
239

Views

Spark dataset and scala.ScalaReflectionException: type V is not a clas

I have the following classes: case class S1(value: String, ws: Map[Int, String]) case class S2(value: String, ws: Map[Int, String], dep: BS) As shown above, these two have one different field which is BS The code below works fine. sparkSQL.createDataset(Seq(S1('heloo', Map(0 -> '0')))).foreach(x =...
Omid
1

votes
1

answer
98

Views

Problems downloading something-something datasets

I am now learning video recognition and want to use the dataset something-something published by twentybn(https://www.twentybn.com/datasets/something-something). I followed the downloading and installing tips in https://github.com/TwentyBN/twentybn-dl, which told me to download the dataset in the vi...
Hanzp
1

votes
1

answer
488

Views

Spark Dataset appending unique ID

I'm looking whether there is an 'already implemented alternative' to append unique ID on a spark dataset. My scenario: I have an incremental job that runs each day processing a batch of information. In this job, I create a dimension table of something and assign unique IDs to each row using monotoni...
Henrique Goulart
1

votes
1

answer
24

Views

Tensorflow netwrok parameters nog updating

Iris dataset classification, network parameters not updating Hey, i tried to build a classifier with a logistic regression netwrok but my parameters are not updating, my weights,bias,output and cost stay the same can somebody help me? I have no idea why my parameters are not updating how can I solve...
Laurens Wissels
1

votes
0

answer
68

Views

convert .data file into .idx file for dataset

I have a file with suffix of .data and .dat as my dataset and I need to convert it into .idx and .arrf to use it as an input. I need it for my java project, I'll be appreciate of your helpping. here is the sample of my data: lib.stat.cmu.edu/datasets/NO2.dat BufferedReader r = new BufferedReader(new...
zara-90
1

votes
0

answer
21

Views

Using UUID in training datasets

I'm quite new to create predictive models, is that possible to use a dataset w/ UUIDs to create a model, and once model's ready, predict a subset w/ UUID. Here's an example COL1, COL2, PARAM1 4e259802-3b80-4e55, 48a9f0af-0c83-4766-a5af, 1a844429-b829-4545 .. .. I'd like to give a parameter to my mo...
dbrrt
1

votes
1

answer
2.1k

Views

load MIT-BIH Arrhythmia Database in python

what is the best file format to use and how can I load the database correctly and plot sgnals in python I am using a .dat file from https://physionet.org/physiobank/database/mitdb/ I used these code import numpy as np import matplotlib.pyplot as plt data = np.genfromtxt('100.dat',delimiter=',')...
Abyr
1

votes
1

answer
178

Views

Schema for type TypeTag[java.sql.Timestamp] is not supported when creating Spark Dataset

Hi I have the following code which tries to create DataFrame from Seq[T] case class CaseConvert[T: TypeTag](a: T) def createDf[T: TypeTag](data: Seq[T]): DataFrame = { spark.createDataFrame(data.map(CaseConvert[T]) } When above createDf method executed by passing type say Seq[java.sql.Timestamp] it...
u449355
1

votes
0

answer
188

Views

Returning java.util.Map from spark UDF results in scala.MatchError: {} (of class java.util.HashMap)

I'm new to Apache Spark and I'm learning how to use it in java. I would like to define and use an user defined function (udf) and I get the scala.MatchError by returning a java.util.HashMap. Here is my code for extracting hashtags from a tweets dataset and adding a new column with a map of the hasht...
Ira Re
1

votes
1

answer
147

Views

Keras convolutional network scoring low on CIFAR-10 Dataset

I'm trying to train a CNN on the CIFAR-10 Dataset in Keras, but I'm only getting around 10% accuracy, essentially random. I'm training over 50 epochs, with a batch size of 32 and learning rate of 0.01. Is there anything in particular that I am doing wrong? import os import numpy as np import pandas...
Rushil Joshi
1

votes
0

answer
68

Views

how to find classes associated given word?-sparql

I want to write a query here https://lod4all.net/sparql.html that finds all the classes associated with a given word. how can I do?
angewo
1

votes
1

answer
38

Views

Xml file handling - xmlstarlet attribute division (for image annotation)

I have an XML file (like the following) Definitiva armas (1) C:\Users\Rob\Desktop\Definitiva\armas (1).jpg Unknown 240 145 3 0 pistol Unspecified 0 0 3 1 128 100 and I want to make the bounding box coordinates from relative to absolute. In other words, I need to update the xmin value by diving its c...
Nikiforos Botis
1

votes
0

answer
52

Views

How to group similar rows in dataset?

I am trying to think of a good way to combine several datasets where each dataset has a slightly different set of information on the same set of items, and therefore includes slightly different data. For example: +----+------+--------+-------+------------------+----------+---------+---------+ | h |...
matmaxgeds
1

votes
0

answer
178

Views

How to import text(not just digit) dataset in tensorflow in format 'tensorflow.examples.tutorials'?

How to import text/character dataset(apart from just digit/MNIST dataset) in tensorflow in a way in which MNIST is imported using tensorflow.examples.tutorials.mnist import input_data as mnist_data ? I searched quite a lot, to find a way in which I can import character/text/alphabet datasets into t...
A H
1

votes
0

answer
66

Views

Devanagari Script Dataset with combined vowels and consonants

Where to get the dataset similar to figure shown below . It is a devanagari script with each consonant having a combination with each vowel.
Harshit Singhal
1

votes
1

answer
589

Views

How do I pass a parameter with Expression as value in ADFv2?

In Azure Data Factory v2 (ADFv2) I am having trouble passing a parameter whose value is an expression that needs evaluated at runtime. For example, I have a set of extracts I want to download daily from the same LinkedService/Connection. I want a pipeline with a Foreach to be able to input a JSON...
jatal
1

votes
2

answer
30

Views

How to merge datasets by common values for variable

I want to merge 6 datasets that have an ID variable. I want to have one data set with ID values common to all datasets. I know this is an easy fix, but I haven;t come across a help topic ex. id month sbp dpb D1 3 40 40 D1 4 10 10 D1 3 20 20 D2 4 30 20 D3 5 10 40 D1 3...
user9459213
1

votes
0

answer
148

Views

How to get a dataset of twitter followers list?

I need to get a twitter or any other social network dataset that has the followers list (not the number of followers but i need the follower id). I need atleast the following details of a user in the following format: Userid,username,followersids.... I would like to get the whole network dataset in...
iyr.anj
1

votes
1

answer
168

Views

Creating datapoints on mouseclick Chart.js

I am new to Chart.js and JavaScript. Currently working with a line chart, and now I want to add custom data points to a mouse click event (when I press somewhere on the data set, it takes the current value of the Y axis and using that value it creates a data point in that place). I took the code fro...
Domkse
1

votes
1

answer
52

Views

tf.train.batch() with my own data? and an issue on training the model

I am trying to understand about why I can't train my network model but I couldn't. I will be very appreciated if you could help me to solve this issue. I already read my image data (600), resized (14x14) and normalize it. Also, I created my onehot_encoding in my code. My 'img_data' variable in the c...
Esriak
1

votes
0

answer
213

Views

Dynamic Dashboard with Large Dataset in Excel

I created an excel dashboard that is feeding on 100 pivot table and source data is approximately 700k and it will grow more every month. In my dashboard, there are list boxes which are changing the source data and if source data changes, pivot tables are refreshing and the dashboard is filling with...
mithrades
1

votes
2

answer
117

Views

Delphi XE 5 TAdsTable Random EAccessViolation on OnCalcFields

I'm getting a random access violation at a few clients sites its happening a few times a week in several different screens and only some clients are effected we are using Advantage components version 10.10.0.51 (ACE 10.10) Seems to be the OnCalcFields that is having this issue I haven't been able to...
Dangas56
1

votes
0

answer
17

Views

DataSet / DataTables with XSD Schema produces wrongly sequenced files

I'm trying to get a dataset with tables written to a validated XML by means of an XSD Schema. StreamReader sr = new StreamReader(ms); ds.ReadXmlSchema('myschema.xsd'); // ds.WriteXml('output.xml'); The output file looks okay, but on closer inspection I found out it won't validate because ds.WriteXml...
Rob
1

votes
0

answer
136

Views

TensorFlow Input dataset

I'm using TensorFlow and python 3.5 this is my code FLAGS = tf.flags.FLAGS tf.flags.DEFINE_integer('batch_size', '2', 'batch size for training') tf.flags.DEFINE_string('logs_dir', 'logs/', 'path to logs directory') tf.flags.DEFINE_string('data_dir', 'Data_zoo/Mer/', 'path to dataset') tf.flags.DEFI...
Balti Hanen
1

votes
1

answer
43

Views

Gnuplot animation of temperature along a bar during time

My dataset consists of a matrix of which the column number corresponds to 20 different positions along a thermally conductive bar and the first column contains the elapsed time of the experiment. In other words, reading the row j of the matrix would give the following data in this order: time t(j),...
Eugenio Gambari

View additional questions