We have been having issues with flaky jobs recently on heroku using sidekiq and redis. We are using sidekiq-cron, and whenever testing locally all our jobs execute fine and without issue on-schedule. It seems however, that we have issues with jobs occassionally not running overnight and when i check the cron tab in our sidekiq web viewer it says "no scheduled jobs were found". If i repush our master branch (empty commit) and re-deploy, the schedule tab comes back in web view and everything then starts running again. In our heroku metrics, I have noticed that, overnight, our sidekiq worker has been running at about 180% of its max memory capacity. could this be causing these intermittent job issues we are seeing where things "just dont run"?. Im at a loss for what to do here since the i havent seen any errors other than customers saying intermittently that they arent getting notification emails. I have just scaled our worker dyno for sidekiq from 1-2 and am hoping that fixes things as we are running a fairly large amount of jobs overnight.
flaky jobs on heroku using sidekiq/redis
86 Views Asked by Ilovebathroomlights At
0
There are 0 best solutions below
Related Questions in HEROKU
- How to get Heroku Support to answer an email?
- Duplicate GET requests - Rails & Heroku
- I am struggling to get a 200 success request for my Heroku-hosted API on Rapid API for GET requests. I only receive a '404 page not found' error
- Heroku Deployment Error: Failed to Push Some Refs to Git Repository
- NOT WORKING domain.com/cv WORK domain.com/cv/ www.bluetrendy.com/cv www.bluetrendy.com/cv/ any ideas?
- I'm going nuts with Heroku session management issues
- Images stored on google drive are not loading on a website hosted on heroku
- Deploy Springboot app on heroku which is using google storage services
- How to run mitmproxy in Heroku?
- Celery Task Tracing ValueError: Unpacking Issue in a Flask Web App Migration, python backend
- Unable to push changes via git behind Proxy with Heroku
- Failed docker deployment: Cannot find module '/app/heroku'
- Request timeout error (H12) on Heroku deployment for website scraping and Excel generation
- Stripe doesn't work after deploying on Heroku by Django
- I got CORS error when trying to do a request in my app in Heroku
Related Questions in REDIS
- How to Socket.IO Multithreading on a Raspberry Pi?
- How to get the session ID returned by cookie with spring-session-data-redis
- Cannot serialize (Spring Boot)
- JEDIS/REDIS 'ON' Keyword or broken query?
- Quart_Sessions Redis deletes keys and create backups instead
- Docker builds redis, mounts the host network and uses 192.168.*.* to access the redis server and is denied
- Need a script to fetch the redis latency values over 20 seconds and store the results in a file
- Service in Docker Compose not connecting to Redis container in docker, Failed to connect to any host resolved for DNS name
- Install redis vector database on GCP in a GKE cluster
- how to avoid while loop while waiting for future complete?
- Is it possible to append the data in Redis command
- Not able to inject RedisCache/SyncCache/StatefulRedisConnection beans in micronaut 4.2.1 version
- RedisConnectionFailureException intermittently
- using redis timeseries in aredes error =>Error handling publish event: [ErrorReply: ERR TSDB: invalid value]
- HttpResponseMessage caching using redis
Related Questions in SIDEKIQ
- My Azure sidekiq process is terminating right after starting?
- Sidekiq job priority
- How to enqueue Sidekiq jobs and execute them only upon manual launch?
- ERROR: CRON JOB: undefined method `perform_later' for #<Sidekiq::Worker::Setter:0x00007fd1af1929f8>. Did you mean? perform_at
- How to prevent sidekiq taking 18 seconds on average to pick up new job?
- checking if there is an existing Sidekiq job for a given object ID
- How to prepend Sidekiq job to beginning of a queue?
- Can't connect to ElastiCache Redis
- Rails fails rescue of PG::UniqueViolation - why?
- Sidekiq performance issues. Htop shows multiple sidekiq processes
- Active Storage Aws::S3::Errors::NoSuchKey error for variant when deleting an attachment
- Ruby on Rails Jobs and MongoDB
- Randomizing job scheduling with cron and sidekiq
- How do I force retrying Sidekiq jobs stuck in the retry queue?
- How to sync sidekiq logs to cloudwatch?
Related Questions in RUBY-ON-RAILS-6
- invitation_accepted? returns FALSE in after_invitation_accepted CALLBACK
- Unknown Syntax Error: Invalid option name ("--production=false") in Heroku deploy of rails app
- Rails 6 - <%= link_to %> Is Not Opening Modal to Confirm Deletion and Just Deleting, How to Ensure Confirmation Before Deletion?
- Flash messages missing in a server rendered page
- Possible to use Action Cable in Rails 6 on Sprockets?. I am stuck here
- ActionController::ParameterMissing in StaticPagesController#contact (Ruby on Rails 6)
- jquery issue in Rails 6 project
- Rails | Use Nested Attribute as Foreign Type For Polymorphic Association?
- Understanding Ruby Versioning Conflicts: Unraveling the Net::ProtocRetryError and Net::BufferedIO::BUFSIZE Warnings
- log error with passenger in rails 6 app : set PASSENGER_COMPILE_NATIVE_SUPPORT_BINARY=0 to disable
- Rails Capybara XPath Feature Spec Not Seeing My Image
- Testing Devise sign_in in a multi-threaded environment
- My Rails Controller Spec is Not Passing When a Redirect Happens
- In Rails how do I swap images using the image_tag and JQuery
- wrong number of arguments (given 2, expected 1) in Rails
Related Questions in SIDEKIQ-CRON
- ERROR: CRON JOB: undefined method `perform_later' for #<Sidekiq::Worker::Setter:0x00007fd1af1929f8>. Did you mean? perform_at
- Randomizing job scheduling with cron and sidekiq
- Some workers are not loaded in sidekiq job, giving NameError:uninitialized constant
- How to manage Sidekiq cron jobs with multiple workers
- How to delete a scheduled sidekiq job, running every minutes even if all code related to this job disappeared from the code base?
- Issues during setup crontab on server with docker
- How to call sidekiq perform fuction after every five minutes in rails
- flaky jobs on heroku using sidekiq/redis
- Delete automatically post with sidekiq-cron
- Sidekiq starting successfully, but systemd restarts every ~1 minute anyway
- Sidekiq-cron doesn't work without ssh to production server
- Sidekiq Scheduler - Rails - Run a Worker On 2nd of every Month
- Creating crob jobs dynamically in rails
- Retry sidekiq job if it is in dead queue in rails
- How can we implement Cron Job using sidekiq-cron on heroku for production
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?