Questions tagged [azure-storage-queues]

0

votes
1

answer
80

Views

Azure function visibilityTimeout

When i read the documentation about visibilityTimeout: https://docs.microsoft.com/en-us/azure/azure-functions/functions-bindings-storage-queue#host-json it says 'The time interval between retries when processing of a message fails.'. How I understands this is that if the timeout is set to 30 seconds...
mslot
1

votes
0

answer
178

Views

Export from Azure Storage Queue to a CSV file

What is the easiest way to export data from Azure Queue to a CSV file without writing codes?
Amir Chatrbahr
1

votes
1

answer
45

Views

Marking message as completed in secondary region of RAGRS Azure Storage Queue if primary regions is down

I am using RAGRS Azure Storage Queue. If the primary region has an outage and the consumer is reading from secondary region of the queue, can it mark the message as completed on that region as it doesn't support write functionality?
mebjas
1

votes
1

answer
35

Views

NServiceBus over AzureStorage Dispatching the message took longer than a visibility timeout

I have NServiceBus running over the AzureStorageQueues Transport. Sometimes, my message handler shows the following two entries in it's log: 2018-08-27 12:27:23.0329 INFO 5 Handling Message... 2018-08-27 12:27:23.7359 WARN 5 Dispatching the message took longer than a visibility timeout. The message...
Shawn de Wet
1

votes
1

answer
48

Views

Azure WebJob with Queue triggered fired multiple times

I have a console app that pushes a lot of messages in parallel to an Azure Storage Queue. There's a continuous triggered Azure WebJob that invokes whenever a message gets added into that queue. In one of the scenarios, I had added 300 items to queue , 100 each in three different threads. Since there...
Ashok
1

votes
1

answer
334

Views

How does transactionScope effect Azure Queue?

If an Azure Queue transaction (push/pop) is made inside of a transactionScope, do they need to be committed or are they done regardless of transaction completeness?
Paul Sachs
1

votes
1

answer
503

Views

Azure Storage Queue - long time to process

I need to generate quite a number of reports and a report can take about 5 minutes to be generated, large amount of data, many different sources. The client will post messages to an Azure Storage Queue. There is a worker roles that processes the messages and generates the reports. If I want to scale...
David Dury
1

votes
2

answer
240

Views

Azure PHP SDK throws Fatal Exception with Socket error

My PHP script reads from my DB and sends messages to the queue so that worker roles (well other LAMP machines) can pull them and work in parallel. However, often times my script ends with a Fatal Error with the following message in my error_log on my apache server. This error is on the sending side...
dinwal
1

votes
2

answer
703

Views

Can't delete azure storage queue message after it has been updated (Message not found)

Used two different libraries for node.js, azure-storage and fast-azure-storage, to the same result. Here's what I do: Create a message with default settings - ok. Get message from a queue - ok. Update message to reset visibility timeout - ok. Delete message after processing - Error: MessageNotFound....
Sergey B
1

votes
3

answer
407

Views

Azure EventHubs inizialization performances and WebApi2

I have a WebApi2 controller that receives XmlHttpRequests from JavaScript. I have +500 calls to the api per second, and any request perform some quick calculations, then I create an Azure Storage Queue (not the service bus one) passing in a serialized object for later processing. Until here all work...
Francesco C.
1

votes
1

answer
151

Views

Retrieving Azure Queue message length in C#

I noticed CloudQueue.ApproximateMessageCount would return the number of messages including the expired ones. This is probably a bug. Is there any way to see how many messages are in the queue?
Kuzey
1

votes
2

answer
824

Views

Long running webjob fail due to Azure Storage timeout

The issue is with a long running azure webjob on a daily schedule. Each run takes 2-4 hours doing data analytics. The only dependencies are with Azure SQL database via EF and with Azure Storage, just setting up AzureWebJobsDashboard and AzureWebJobsStorage connections on the App.Config, standard set...
donquijote
1

votes
1

answer
407

Views

Azure Function reaching timeout without doing anything

I have an Azure Function app in Node.js with a couple of Queue-triggered functions. These were working great, until I saw a couple of timeouts in my function logs. From that point, none of my triggered functions are actually doing anything. They just keep timing out even before executing the first l...
Schaemelhout
1

votes
1

answer
988

Views

Clearing the Queue on Azure Storage Queue

I'm running some tests on my web app which has a WebJob running to handle some backend tasks. I connect to the queue using Cloud Explorer in Visual Studio and clear all the messages from the queue. When I restart my WebJob, it still finds messages and tries to process them. Where are these messages...
Sam
1

votes
1

answer
597

Views

Azure queue throttling error with few requests (StorageException: The server is busy)

Language: C# Framework: .NET CORE 1.1.1 Nuget: WindowsAzure.Storage version 8.1.1 Hi, I use a queue storage on Azure. I have 4 programs which make each 1 request/second (GetMessagesAsync request). So I make 4 request/seconds. But sometimes, there is throttling errors that results on this exception :...
JohnB
1

votes
1

answer
195

Views

In Azure Webjob When using CustomQueueProcessorFactory messages returns to queue even after DeleteMessageAsync is called

I have tried implementing my own QueueProcessorFactory, and it works fine, besides one thing I can’t wrap my head around. After I have tried a message for 5 times (default) it runs CopyMessageToPoisonQueueAsync and then DeleteMessageAsync. So far so good, but 10 minutes later the message appears...
Cinaird
1

votes
1

answer
206

Views

Azure function, flexible test and production queue names

How can I design my Azure Function hosting for flexible test/production queue isolation? I am planning to write 6 precompiled Azure Functions in C# packaged as single DLL and have yet to to decide if I will use WebJobSdk function annotation or multiple .json config files. My 6 Azure functions will o...
camelCase
1

votes
1

answer
616

Views

Azure Functions Can't bind Queue to type CloudQueue

I am getting this error from a QueueTrigger function that also needs a CloudQueue binding. Microsoft.Azure.WebJobs.Host.Indexers.FunctionIndexingException : Error indexing method 'QueueInstancesToImport.Run' ---> System.InvalidOperationException : Can't bind Queue to type 'Microsoft.WindowsAzure.Sto...
Andrew Hawes
1

votes
1

answer
217

Views

How can I wait for an Azure CloudQueue to be deleted?

I am running some tests that use Azure CloudQueue, and as setup/teardown I am calling CreateIfNotExistsAsync() and DeleteIfExistsAsync(). However when I am running my tests back to back I got a Microsoft.WindowsAzure.Storage.StorageException,'The remote server returned an error: (409) Conflict.' awa...
watashiSHUN
1

votes
1

answer
355

Views

how to get the dequeue count in azure functions with powershell

I have implemented an azure storage queue triggered azure function with powershell. Now i'am looking for an solution to read the dequeue count of the queue item to implement an error handling function. For C# I have found some solutions from MS but not for PS. #r 'Microsoft.WindowsAzure.Storage' usi...
theface
1

votes
1

answer
142

Views

Fatal Error - Azure Storage Queues with Service Fabric

I have been trying to add listeners for messages posted on the Azure storage Queues inside of the Service Fabric. The code snippets that I have used in my stateless service are as follows: using System; using System.Collections.Generic; using System.Diagnostics; using System.Fabric; using System.Li...
Farax
1

votes
1

answer
259

Views

Azure Storage emulator with Nodejs createQueueService error

I'm receiving the following error when I try connecting to the emulated storage queue service: The MAC signature found in the HTTP request '...' is not the same as any computed signature. Make sure the value of Authorization header is formed correctly including the signature. This is the approach I'...
ReDEyeS
1

votes
1

answer
0

Views

Azure Storage Queue max value for MaxDequeueCount

Could anyone answer me how many retry attempts can Azure execute on a Queue message? If I set MaxDequeueCount = Int32.MaxValue, will Azure really trigger any binded to this queue function 2147483647 times? Thank you.
Artyom Gilevich
1

votes
2

answer
288

Views

Error getaddrinfo in azurestorage and NodeJS

I'm doing and application that send a file to Azure Storage Container and after this send a message to Azure Queue. I cann't send more files and messages when I reach about 1000~1020 messages. I noticed too, that when I try to check how many messages are in the queue, I have an error. The error is:...
RenanMPN
1

votes
1

answer
202

Views

Use Azure webjobs and queue storage to execute at a given time

My goal is to push a message to the Azure queue, and have the webjob handle it at a given time. E.g. { message : 'remember the milk', time: 2016-02-10-10:10:00} I could do this naively by dequeueing the message, check the timestamp, and put it back on the queue if the time has not come. Is there a...
MrCalzone
1

votes
1

answer
1.7k

Views

Azure WebJob ProcessQueueMessage fails to read CloudQueueMessage

In summary, I have an Azure Web Job linked to a CloudQueue via the WebJobs SDK's ProcessQueueMessage mechanism, using the CloudQueueMessage parameter type. This gives me a FunctionInvocationException when triggered via QueueTrigger. Detail The item is added successfully to the CloudQueue using the A...
richaux
1

votes
1

answer
745

Views

How to Create an Azure Queue Storage Message when a Blob File is Uploaded/Updated?

I am using Azure Storage Explorer to upload blob files into an Azure Storage Account. And would like to send a message to an Azure Storage Queue for every uploaded/updated file. The message will contain the name of the file. These messages will be used by an Azure Webjob to identify which files to...
XY6
1

votes
1

answer
286

Views

Azure Queue to receive http requests

I want to know if it is possible to create an Azure Queue (Service bus or Storage Queue) which can be placed in front of a web application and receives http requests very fist. updates Thanks for the comments and answers. I want to process the request without burding IIS. I need to make it possible...
user217648
1

votes
2

answer
51

Views

Azure Queue to inform about pending message constantly

I can't find in Azure documentation how to find out when the new message is waiting for my service, which will make use of it. One option is to use async method forever, but it does not seem to be an elegant solution. Is there any 'right' way of doing this?
Artur Pschybysz
1

votes
1

answer
2k

Views

How do I debug azure function locally

Hello I have created a function in Azure Portal and seeing the queue data dequeued. I have installed an CLI on my computer which when I run the project it will show a func.exe command prompt. I have added the connection string like this, inside the local.settings.json: > 'Values': { 'AzureWebJobsS...
LittleFunny
1

votes
2

answer
1.5k

Views

Checking if a queue exists

I have a very basic question about Windows Azure Storage Queue errors/access. I am trying to find out if the given storage account already contains a queue by the given name - say 'queue1'. I do not want to create the queue if it does not exist, and so am not keen on using the CreateIfNotExist metho...
nightcrawler
1

votes
1

answer
116

Views

Azure storage queue/functions, dequeue from poison queue only once

I have a problem with azure storage functions+azure storage queue. I have a queue - 'myQueue' and queue-triggered azure function 'func1'. In host.json I've configured maxDequeueCount(5) and visibilityTimeout - everything works nice. After 5 tries my message goes to 'myQueue-poison'. I have second...
blidea
1

votes
2

answer
945

Views

Can I queue multiple items from a single run of an Azure Function?

I have a Node.js timerTrigger Azure function that processes a collection and queues the processing results for further processing (by a Node.js queueTrigger function). The code is something like the following: module.exports = function (context, myTimer) { collection.forEach(function (item) { var it...
TheBlueSky
2

votes
3

answer
1.5k

Views

Azure Storage Queue - Retrieving hidden messages

Is there a way to retrieve azure storage queue messages that are hidden? Background - I have been searching for an app/cmdlet/third party tool that would let me backup the entire queue including hidden messages (for troubleshooting purposes) but unable to find one. I have also considered writing a...
infinity
2

votes
0

answer
406

Views

Can I control request timeouts within Azure Storage Retry Policies?

It took me some time to understand the idea behind the RetryPolicies the Azure Storage SDK (and probably otehr SDKs as well) provides. For Microsoft documentation see https://docs.microsoft.com/en-us/azure/architecture/best-practices/retry-service-specific#azure-storage-retry-guidelines Consider the...
lapsus
17

votes
1

answer
8.6k

Views

How does WebJob QueueTrigger trigger, polling or event?

public static void ProcessMessage([QueueTrigger('queue')] string message, TextWriter log) { //processing message } How exactly this method will be triggered. Is WebJob host just poling the Storage Queue. Or Storage Queue raising new message event, that host subscribed to?
Alexander S.
3

votes
2

answer
4.4k

Views

Requeue or delete messages in Azure Storage Queues via WebJobs

I was hoping if someone can clarify a few things regarding Azure Storage Queues and their interaction with WebJobs: To perform recurring background tasks (i.e. add to queue once, then repeat at set intervals), is there a way to update the same message delivered in the QueueTrigger function so that i...
Nick
5

votes
3

answer
2.3k

Views

Windows Azure SDK for C++

Part of my project is worker application written in C++, running on Linux. I just find out that MS doesn't provide C++ version of Windows Azure SDK. I need to access Windows Azure Storage Queue. Is there any C++ port of SDK? Is there any chance to use SDK from other language (i.e. python, node.js)?...
Ari
2

votes
1

answer
556

Views

Poll-and-sleep on Azure storage queue from WebJob

I know that there is the QueueTrigger stuff that gets invoked when a new message is available in the queue. However, this 'Framework style' WebJobs make it complicated for me to initialize my environment correctly. This is why I want to poll the queue myself, the basic pattern is like this: var acco...
theDmi
2

votes
3

answer
2.4k

Views

Implementing Delay Queue using one or more standard FIFO Queues [closed]

A delay queue is a queue in which each message has a delay time associated with it and a message can only be taken when its delay has expired. The head of the queue is that message whose delay expired furthest in the past. If no delay has expired there is no head and dequeue will return null. Actual...
Ravi Gupta

View additional questions