Tag Archives: tech

How We QA at Chirpify

The moment you implement a process that reduces mistakes, or improves how you respond to mistakes is the moment your QA process is born. If you’re lucky this started long before you hired testers or QA engineers, but almost certainly you started to think more seriously about it when your team or product grew to a certain size. Thankfully its been a priority here since early on.

It’s been an iterative and sometimes transformative process as we’ve grown to serve hundreds of clients and hundreds of thousands of users. Here is a little bit of info on how we do it.

The User

Who are our Users? Mostly they’re mobile (60% + and counting) and increasingly they’re transacting with us across multiple channels. They’re coming across a Chirpify campaign in the midst of doing something else, so we need to be not just easy to use, but as invisible and lightweight as possible.

My new favorite comment when discussing features is “That’s great, but how does it look in mobile?”. Testing natively on actual Android and iOS devices in the office pairs with tools like Chrome’s mobile viewport emulator to help quickly surface bugs.

Before reaching the testing stage, a bigger focus on faster load times, and asset size optimization in development pairs well with the responsive frameworks, like Bootstrap, that we already have in place. With that said we’re continually on the lookout for tools to help us better serve our ever broadening user base.

The Engineer

Testing starts with the engineer, reviewing their own code, and testing the “Happy Paths” of the requirements and scope, this all happens locally and on a staging environment that mimics production.

Of course nothing moves on for further review if the tests are broken. All our repos plug into CircleCi and tests are run automatically in the background every time a pull request is made, which allows for an easy at a glance pass-fail check to move ahead. Once it does pass, the feature shuffles off to QA.

The QA Engineer

We treat QA as a fast moving part of the tail end of the development process. Once a ticket is in my hands we practice quick turnaround of fixes as tickets are filed. This is good not just because of the turnaround time, but also because a feature is often being iteratively improved immediately while its fresh in the developers mind.

As QA gets closer to completion and approval we’re able to integrate feedback from product stakeholders as well in the same rapid turnaround process.

Once completed we work to deploy as soon as possible. On to the next one.

The Stakeholder

Product stakeholders are never far away from the product and usually are providing feedback before a product leaves QA. This allows us to make quick decisions about UX, UI and deeper functionality no matter where we are in the development process.

The Product

One of the practical difficulties of testing our platform lies in our “invisible” software. After a registration process a user may not see our app UI for months at a time even while our software powers their participation, through location check-ins, messaging, and image posts.

Users may not notice the absence of notifications, so we need to be smart about how we gauge the health of our messaging. Analytics become an important part of this process, where we can build a funnel of user actions, our messaging, and finally a transaction and its receipt. Monitoring volumes and ratios of responses allows us to quickly diagnose discrepancies at scale, instead of fruitlessly trying to watch for user interactions and responses one by one.

When we’re not being invisible, however, we’re interacting with the User either through our app UI, e-mails, or messages on social. All logged meticulously and often cross referenced. What powers our end to end testing of messaging and user interaction is also paving the way for deeper customer insights as we learn more about just how users prefer to interact on social.

The Automation

I’m in love with any kind of automation, and we’re working hard to bring it to every facet of our product development.

Testing lives on CircleCI, giving us quick feedback and easy reviews of Pull Requests with inline information on whether tests have passed in Github. No passing tests? Instant veto.

CasperJS powers my UI testing, and quickly lets me know of more glaring issues in a manner of seconds. Its been a life saver for integration testing our UI which can in theory support thousands of permutations. What sold me on it? I was writing specs within two minutes of deciding to use and deploy it. Sold.

Puppet powers our deployment and removes a lot of uncertainty around maintaing a vast array of often changing AWS instances. We’ve only just scratched the surface here, but there is a lot to love already.

The Checklist(s)

Any checklist is just a placeholder for potential automation and happily we’ve managed to convert many of our checklists into hands off processes that are much more resistant to failure and human error. Deployment, UI testing, code review, and social messaging are all in some stage of automation and we’ll continue to improve them.

The Deploy

If we’re diligent we’re deploying daily across multiple stacks, with the help of Puppet and AWS with small iterative changes sometimes being released multiple times in a day as they come ready.

If you liked what you read and are interested becoming a part of and helping us improve this process, drop us a line. We’re hiring.

Written by Johann Hannesson |QA Chirpify

We had a great time at CES this year, joining some great companies at the The Mindshare HuddleA round robin with emerging companies in the industry revolving around the theme of Adaptive Marketing. 

We joined Foursquare, Tumblr, Percolate, Wave, Kiip and many more to discuss the importance of social + mobile + hashtags and what they mean as a serious social conversion opportunity for brands both online and offline. 

Watch the video above to see our very own Kevin Tate talk about Chirpify and it’s value to brands in social media. 

Read the full article on Beet.TV here.

Forever 21 Activates Holiday Commerce Promotion

Beeminder Users Chirpify API

We love our API partners. They’re sharp and creative, which is exactly what we look for in our partners. Tweet-a-Beer exploded overnight at SxSw and now one of our newest API partners, Beeminder, is all the buzz.

We sat down with Beeminder (who happens to work in the office space above us) and chat a little bit about their service and integration with Chirpify.


Q: What is Beeminder?

A: Beeminder is a tool that helps align actions and intention to improve life for individuals
and groups. Essentially, someone sets a goal, tracks the progress of their goals and achievements.Most goal-tracking software uses positive reinforcement, but Beeminder has taken a different approach. Beeminder uses Negative Punishment (or omission training) to motivate people.When you set a goal, you have the option to create a challenge with monetary value. If you fail you goal, you pay up. It literally puts the money where your mouth is.

Q: What were the goals in implementing Chirpify’s API?

A: Simply put, make payments, goal-centric focus inherently social. By adding the potential for public shame and public payment, we see it as another motivation tool.

Q: What are the specifics of your API integration?

A: We added it as another payment option, much like a credit card. If you fail your goal/contract, Beeminder emails you to notify you of such failure. Then our API calls Chirpify to process the payment. A tweet is automatically generated from your account, and the payment is sent.

Q: Where can we learn more about Beeminder?

A: Our website. You can read about our Chirpify integration on our latest blog too!

Chat, Chow and Chirp-

In the past few months, we’ve seen companies and individuals using Chirpify in new and unique ways. We’re going to start writing about some of these cool folks. If you see any cool Chirpify companies, let us know!

Chat Chow is one of these unique companies. We recently sat down with them for a quick Chirp Chat.

Q: Tell us a little bit about your podcast.

A: Chat Chow TV is a weekly, mouth-watering video podcast where we go behind the scenes with the celebrated chefs, owners and mixologists of the food industry.

Q: How did you first hear about Chirpify?

A: At SxSW, with the Tweet-A-Beer application.

Q: Explain how Chat Chow used Chirpify recently.

A: In honor of our one-year anniversary, we decided to cook up something for all of our fellow foodies, both new and old. We called it #ChatChowCheers and it began April 1st (not a joke) and ended on April 30th. We randomly scoured the TwitterSphere for people thinking of, heading to or eating at any of the restaurants that have been featured on Chat Chow TV in the past year and sent them money for a drink (courtesy of Chirpify) because the virtual transportation of alcoholic beverages is still only found in science fiction.

You can see more information on #ChatChowCheers here.

Q: How can Chirpify users find out more about Chat Chow TV?

Visit our website!