Jenkins

Jenkins

DevOps / Build, Test, Deploy / Continuous Integration
Needs advice
on
RabbitMQRabbitMQSupervisordSupervisord
and
SymfonySymfony

Hello, I'm using Supervisord for separate process manager/consumer with RabbitMQ and Symfony but it's not working properly, it disconnects after a couple of hours.. and for a workaround, I'm using a restart job on Jenkins (as in the linked issue in GitHub) but tbh I would like to have a clean stack.. if anyone knows a better alternative than supervisord it will be awesome..

Many thanks!

READ MORE
Process stops processing messages after certain amount of time · Issue #28 · ricbra/rabbitmq-cli-consumer · GitHub (github.com)
10 upvotes·25.1K views
Replies (2)

I've had good experiences moving from Supervisord to using systemd for managing processes, especially for setups involving RabbitMQ and Symfony. Systemd not only integrates well with the system, offering better control and management, but it also simplifies logging through journalctl and handles automatic restarts seamlessly.

Here's what I did to make the switch: - Craft a Service File: I wrote a .service file in /etc/systemd/system/ to describe my service. It includes details on how to start and stop the process, among other things. - Set Up Service Behavior: Inside this file, I specified commands like ExecStart for launching my process, Restart to ensure it always restarts after failure, and set the User to define which user runs the process. - Enable and Launch the Service: With systemctl enable my-service.service, I made sure my service would start on boot, and systemctl start my-service.service got it running right away. - Manage and Log: Whenever I needed to check on things, journalctl was there for logs, and systemctl helped me manage the service (like checking its status or restarting it). - Switching to systemd resolved the disconnection issues I faced without needing any workarounds like restartingI've had good experiences moving from Supervisord to using systemd for managing processes, especially for setups involving RabbitMQ and Symfony. Systemd not only integrates well with the system, offering better control and management, but it also simplifies logging through journalctl and handles automatic restarts seamlessly.

Here's what I did to make the switch: - Craft a Service File: I wrote a .service file in /etc/systemd/system/ to describe my service. It includes details on how to start and stop the process, among other things. - Set Up Service Behavior: Inside this file, I specified commands like ExecStart for launching my process, Restart to ensure it always restarts after failure, and set the User to define which user runs the process. - Enable and Launch the Service: With systemctl enable my-service.service, I made sure my service would start on boot, and systemctl start my-service.service got it running right away. - Manage and Log: Whenever I needed to check on things, journalctl was there for logs, and systemctl helped me manage the service (like checking its status or restarting it). - Switching to systemd resolved the disconnection issues I faced without needing any workarounds like restart jobs. It felt like a cleaner, more reliable approach.

READ MORE
6 upvotes·1 comment·5.9K views
mwlazlo885
mwlazlo885
·
February 16th 2024 at 6:56PM

Many thanks for the recommendation! I will give it a try, thanks : )

·
Reply
Needs advice
on
BlazeMeterBlazeMeterGatlingGatling
and
k6k6

Kindly suggest the best tool for generating 10Mn+ concurrent user load. The tool must support MQTT traffic, REST API, support to interfaces such as Kafka, websockets, persistence HTTP connection, auth type support to assess the support /coverage.

The tool can be integrated into CI pipelines like Azure Pipelines, GitHub, and Jenkins.

READ MORE
9 upvotes·263.7K views
Replies (1)
Recommends
on
RedLine13

JMeter is best suited for generating user load with built-in integrations. To generate that type of load, you’ll need to choose a cloud-based solution that runs JMeter, such as BlazeMeter or RedLine13. They support JMeter for testing RESTful APIs and there is a plugin specifically designed for MQTT. You’ll want to look at subscription options and costs to run at that great a load.

There are JMeter plugins you can configure for all sorts of profiling including persistence of connections. And third-party plugins that you can add as JAR files to your load test, such as this one specifically for Kafka. JMeter also has good support for configuring authorization headers.

With regard to CI/CD integration, both support Jenkins. RedLine13 has a custom Jenkins plugin and allows for resources for tests to be sourced from GitHub and other places like AWS S3.

READ MORE
6 upvotes·1 comment·12.1K views
Kapil Srivastava
Kapil Srivastava
·
May 4th 2023 at 6:27AM

If using AWS then use Database Migration Service to connect to these sources. You might need DBAs support for making the logs replicable in the source and write some transformations to convert the incoming record compatible to progreSQL.

·
Reply
Needs advice
on
AnsibleAnsible
and
RundeckRundeck

We have a lot of operations running using Rundeck (including deployments) and we also have various roles created in Ansible for infrastructure creation, which we execute using Rundeck. Rundeck we are using a community edition. Since we are already using Rundeck for executing the Ansible role, need an advice. What difference will it make if we replace Rundeck with Ansible Tower? Advantages and Disadvantages? We are using Jenkins to call Rundeck Job, same will be used for Ansible Tower if we replace Rundeck.

READ MORE
6 upvotes·80.2K views
Replies (1)

I never use Tower, but I can recommend Ansible Semaphore as alternative to Rundeck. It is lightweight, easy to use and tailored for work with Ansible.

READ MORE
3 upvotes·2 comments·21.5K views
Patrick Humpal
Patrick Humpal
·
February 3rd 2022 at 1:40AM

What about using Ansible w/CodeBuild and an assume role if there are multiple AWS accounts? Or having Jenkins jobs that run the Ansible playbook / roles you need?

·
Reply
Gourav Lokhande
Gourav Lokhande
·
March 9th 2024 at 7:43AM

I have been using Ansible from last 3 years great tool it can do many things if you think it is not achievable customize it.

·
Reply
Needs advice
on
Jenkins XJenkins X
and
Red Hat OpenShiftRed Hat OpenShift

We are a midsize company, and we are using Jenkins as our CI/CD tool on Red Hat OpenShift. We anticipate to grow bigger and are planning to have multiple Jenkins per squad. We are fighting the battle of Jenkins on EC2 vs RedHat keeping in mind

1) centrally managing the Jenkins

2) Jenkins config as a code

3) Auto Scale

4) Disaster Recovery

5) Upgrading Jenkins and its plugins

READ MORE
7 upvotes·24.5K views
Replies (1)
Technical Lead at CDAC·

Hi, since you are already using Red Hat Openshift so you are aware of how good Red Hat products are. Going with Red Hat will give you more flexibility considering points that you have mentioned. Red Hat products are based around an approach of providing flexible and scalable architecture where you can easily manage your instances in a cloud native manner. You can also have a look at Red Hat Ansible which will provide your team to run Infrastucture as a code. For Jenkins, you can easily set up and automate the things based on manifests file. You can also automate the things based on multiple environments.

READ MORE
5 upvotes·1 comment·6.5K views
Kees Koenen
Kees Koenen
·
January 15th 2022 at 6:22PM

If you're already on openshift, also take a look at openshift pipelines, which is based on Tekton. It's Kubernetes native and may make your life (LCM) a bit easier.

https://docs.openshift.com/container-platform/4.8/cicd/jenkins-tekton/migrating-from-jenkins-to-tekton.html

·
Reply
Needs advice
on
BambooBambooGitLabGitLab
and
JenkinsJenkins
at
()

I am choosing a DevOps toolset for my team. GitLab is open source and quite cloud-native. Jenkins has a very popular environment system but old-style technicals. Bamboo is very nice but integrated only with Atlassian products.

READ MORE
CSDN博客 - 专业IT技术发表平台 (blog.csdn.net)
2 upvotes·52.9K views
Replies (1)
Founder at Odix·
Recommends
on
GitLab
Jenkins

Hello Xie, here are the tools am using for my entire CI/CD pipeline : 1-Jenkins (make sure to install Blue Ocean plugin) it will make your life easier and it's user friendly. 2-Gitlab as a container registry for my docker images (you can use it for code source too of course) 3-Github for version control and source code (make sure to benefit from webhooks to interact with your jenkins server). 4-Ansible : in order to automatically execute shell commands on different machines local and remote. 5-As always i recommend Kubernetes to manage containers (that's what am using) Best of luck

READ MORE
3 upvotes·3 comments·309 views
Ross M.
Ross M.
·
May 12th 2021 at 1:00PM

You should consider what kind of services you are trying to devop. WebStack? containerized processes? Binaries (like games?) Who is going to be the DevOp in your team (it might guide you if you want something simple or powerful)?

Jenkins is a powerful and sometimes intimidating toolbox that would make you go down a rabbit hole. I am pretty sure you will find a way to do it in Jenkins. It will not only work for webstack but also binaries (like game builds, you name it)

Gitlab is a little more pruned but very well equipped service. You will feel more guided with their interface. Also, it let you host your own Runner which give the flexibility to not always rely on container if you can't use that.

I dont know Bamboo that much but Bitbucket Cloud comes with what they call Bitbucket pipeline and it's mostly useful if you know your pipeline can be all run through containers.

·
Reply
xie zhifeng
xie zhifeng
·
May 26th 2021 at 1:12AM

mainly webstacks

·
Reply
xie zhifeng
xie zhifeng
·
May 26th 2021 at 1:11AM

Thanks! Then I will have trial those tools!

·
Reply
Needs advice
on
GatlingGatling
and
LocustLocust

I am looking for a performance testing tool that I can use for testing the documents accessed by many users simultaneously. I also want to integrate Jenkins with the performance automation tool. I am not able to decide which shall I choose Gatling or Locust. But for me, Jenkins integration is important. I am looking for suggestions for this scenario.

READ MORE
6 upvotes·82.4K views
Needs advice
on
JenkinsJenkins
and
Octopus DeployOctopus Deploy

What is the difference between Jenkins deployment and Octopus Deploy? Please suggest which is better?

READ MORE
2 upvotes·25.6K views
Replies (1)

Octopus is continuous deployment tool, while jenkins is general-purpose CI/CD platform, normally Octopus is used after (integrated with) Jenkins.

Normally octopus is compared with Harness and Spinnaker

Which one is better always depends on your use case? try one and use another tool to compare, you will get it by yourself.

READ MORE
1 upvote·158 views

Hi, I need advice. In my project, we are using Bitbucket hosted on-prem, Jenkins, and Jira. Also, we have restrictions not to use any plugins for code review, code quality, code security, etc., with bitbucket. Now we want to migrate to AWS CodeCommit, which would mean that we can use, let's say, Amazon CodeGuru for code reviews and move to AWS CodeBuild and AWS CodePipeline for build automation in the future rather than using Jenkins.

Now I want advice on below.

  1. Is it a good idea to migrate from Bitbucket to AWS Codecommit?
  2. If we want to integrate Jira with AWS Codecommit, then how can we do this? If a developer makes any changes in Jira, then a build should be triggered automatically in AWS and create a Jira ticket if the build fails. So, how can we achieve this?
READ MORE
3 upvotes·476.6K views
Replies (1)
Design Lead | Senior Software Developer ·

Hi Kavita. It would be useful to explain in a bit more detail the integration to Jira you would like to achieve. Some of the Jira plugins will work with any git repository, regardless if its github/bitbucket/gitlab.

READ MORE
1 upvote·307.1K views

Objective: I am trying to build a custom service that will create VMs in Azure, based on inputs taken from a web interface. I want the backend code that interacts with Azure to be PowerShell.

Ask: Hoping to find help with deciding the simplest architecture of tools to achieve this.

What I have so far with my Limited Knowledge: I am new to Azure and Jenkins. I arrived at Jenkins coz it can run PowerShell and has API that can be called to trigger a job. Although integrating with it over the web seems problematic since its on-prem network. I hear it is possible using the VPN. For the Web, I hope to use Azure Web App with Python/Node.js that I can manage to make API calls to Jenkins.

Is there a better way? I just need help getting the right directions; I will walk the way.

READ MORE
6 upvotes·398K views
Replies (3)

You must have gone through multiple thoughts on how to handle the requirement, but the biggest problem that I am able to see here is a dependency on a certain platform for executing Powershell scripts. Next is being a developer will never suggest having Powershell or bash as a backend of your system until it is related to some IoT Stuff. In place of it, I would rather suggest you use Infrastructure as a Code that comes with terraform or Ansible or as your application is based on Azure so u can use Azure Resource Manager too.

Adding to it for making config or attaching a trigger to these infrastructure controllers, you can use lightweight stateful APIs with the help of flask or express or go-mux, to keep track on the progress of deployments.

READ MORE
4 upvotes·817 views
Software Engineer at Autodesk·

I'd recommend against using PowerShell as a backend, unless your logic is very simple (maybe less than 100 lines total). I've worked with a huge framework written in PowerShell, and we hit a lot of bugs. (Some of the issues traced back to bugs in the PowerShell runtime itself! Most of the team who owned the PowerShell framework admitted that if they could reimplement it they would pick a different language.) If you're already using Python, then I'd recommend using Python for other backend code -- or a more structured .NET language, like C#.

READ MORE
4 upvotes·2.3K views
View all (3)
Sr. Business Analyst_PMO at IT·

Hey!

We are planning to migrate web application with the same UI AngularJS to #AWS cloud with AWS Elastic Load Balancing (ELB), Jenkins, Docker stack, to check its performance for 200 users. Any suggestions for alternative technologies?

What is the infra required?

Thanks in advance.

READ MORE
2 upvotes·53K views