Wednesday, September 16, 2009

The Retrospective of Retrospectives

Feedback is one of the XP values and key mechanism for all the agile methodologies. For example, Scrum teams religiously have Retrospective at the end of each iteration. This enables the team to reflect and adapt, improving the process for the next iteration. Agile Teams learn from their successes and failures. Retrospectives provide an effective way to incorporate feedback into the project.

But what about large Agile teams? Once again I will use my current large Agile program as a case study:

Lately I have been working on a large Agile program. With the large Agile program, comes common large team challenges, and the need to adapt the Agile development and management practices to better suit the large team challenges.

Currently the program has around 180 people distributed over 12 teams. Typically, each team is formed by 15 people (project manager, business analyst, quality assurance and developers; for short: PM, BAs, QAs and Devs). All teams in the program are following Agile practices, such as 2 week Iterations, Daily Scrums and End of Iteration retrospectives.

The teams were getting good value out of the Retrospective Agile practice. But the improvements were done in a team level. And the overall program was losing focus on continuous improvement. At times, the action point from one team’s retrospective was dependent on other teams. Other times, two team retrospective action points were contradictory.

Another challenge was that the program level management was not able to attend every team retrospective. There were 15 retrospectives happening at the end of each Iteration, The program manager (and other people) would like to attend each team retrospective; but it was just not possible to be at several meeting at the same time.

Retrospective of Retrospectives


Similarly to how the daily scrum is extended to the Scrum of Scrums for large Agile teams, I came up with the idea of having a Retrospective of Retrospectives for large Agile teams.

The Retrospective of Retrospectives (RoR for short) meeting is held after each individual team retrospective. The participants (representatives of all team and the program) meet to discuss what went well and what to improve in the program level. The RoR focus is on improving the overall program output, and not on individual team performance.

RoR format


Data gathering: The top 5 items from each team retrospective is the start point for discussions and possible program action items.

Participants: Similarly to the Scrum of Scrums, all managers participate in this meeting. The attendance of another representative of each team is recommended; and it is encouraged to be in a rotation basis.

Context: The context for the RoR is slightly different than the context for individual team retrospectives. While the context for a end or iteration retrospective might be: what can we do to improve next iteration for our team, The RoR context is: What can we do as one team (the whole program team) to improve the overall output for the program.

Mechanics: Each team retrospective top items are read. Repetitions and alike items are grouped together. Then the items go for voting. (for example 3 votes per participant).

RoR top benefits


Below are the top benefits I noticed from the RoR.

Quick access to all teams – all managers and stake holders have visibility on the top items for each individual team. And all is available in only one meeting.

Focus on improvement – for both the individual teams and the program level. One common problem on large agile projects is that one loses focus on the overall program by constantly focusing on local improvements. It is like being around the trees and lose sight of the forest.

Common goal – All managers (and the selected team members) are periodically talking and acting on the overall goal of the program. The RoR participants carry the common goal message (and action points) back to their teams.

Everyone is heard– Any local team problem will be heard by all the teams. Even if something is specific for a team, the message (team retrospective item) will be heard by all teams.

30 comments:

Sachin said...

RoR!

Dude, hope the Ruby on Rails community don't sue you! :P

Fabio Pereira said...

Hey Paulo,

very good post about the RoR! :)
I'm working on a project with 30 people at the moment, we are not co-located. it's almost half/half in 2 cities (Sydney/Melbourne). We managed to do something similar for the Retros, which is working. But we are having some problems with Stand-Up meetings...

What we have been trying is on Mon/Wed/Fri separate stand-ups in the different cities and on person from each side attends the other stand-up. And on Tue/Thu we have a video conference stand-up with everyone... But it's very hard to keep everyone engaged and focused when 30 people are talking about different things. And it's even worse because we are horizontally split... It's not even a feature team split, it's the common and bad Front-End/Middleware/Backend kind of split... :(

I was wondering if you have tried anything for large teams for stand-up meetings that worked well?

Cheers

Paulo Caroli said...

Hey Fabio,

As you already mentioned, the horizontal split might be adding to the large team communication challenge.

I blogged about the Daily Scrum, and how it went thought different stages in my large program.
http://agiletips.blogspot.com/2009/05/three-stages-of-daily-scrum.html

My suggestions are:
(1) Keep on adapting to your team situation, size and structure at hand; SoS style, who attend, its format, and communication media.

(2) Complement the daily scrum, or SoS with dev huddles, QA catch up, BA workshops, PM meeting, etc. Meetings with all team members might help keeping the overall team goal; but you will also require close interactions for people playing similar roles (and hopefully these people will share context on several functional areas)

Cheers,

mike said...

I found your blog on google and read a few of your other posts. I just added you to my Google News Reader. Keep up the good work. Look forward to reading more from you in the future. Please come visit my site systemic lupus erythematosus when you got time.

mike said...

Really great work. Congrats to everyone who are involved with this project. The website layout and graphics are really cool. Please visit my site Chicago Business Directory when you got time.

aiai said...

For a pair of sleek gloves that would look great with your suit, pick up the Ross Gloves Italian Sheepskin Gloves with Cashmere lining. These gloves are perfect for those who live in metropolitan areas
spyder skiwhere the temperatures drop in the winter because these gloves are lined with extra warm and soft cashmere for that added layer of spyderwarmth and insulation. The premium Italian lambskin will mold to your hands in a close fit and the slim lines of this glove are convenient enough to slip into your pockets when not neededspyder jacket.

For a great pair of gloves that will keep up with you on the slopes even spyder ski wearin the harshest of temperatures, pick up the Burton' Gore-Tex Under Gloves for $64.95. The Thermacore insulation on these ski jacketgloves will keep your fingers warm even when the freezing wind and slate beats down on you. spyderThe DryRide Ultrashell combined with the Gore-Tex Insert ensures that nothing will get your fingers wet. spyderThe hidden heater and vent pocket stashes extra warmth on the cold days and dumps spyder jacketsexcess heat in the spring. spyder ski wearIf you are worried about your goggles getting steamed up, these gloves help solve that problem with the soft chamois goggle wipe which will keep your vision clear.

Sonica said...

Thank you for the info. It sounds pretty user friendly. I guess I’ll pick one up for fun. Thank u.


Scrum Process

angelyu said...

ACER TravelMate 6292 Series Laptop batteryACER TravelMate 6292 Series Laptop battery
ACER TravelMate 6291 Series Laptop batteryACER TravelMate 6291 Series Laptop battery
ACER TravelMate 6252 Laptop batteryACER TravelMate 6252 Laptop battery
ACER TravelMate 6231 Series Laptop batteryACER TravelMate 6231 Series Laptop battery
ACER TravelMate 4720 Laptop batteryACER TravelMate 4720 Laptop battery
ACER TravelMate 4520 Laptop batteryACER TravelMate 4520 Laptop battery
ACER TravelMate 4320 Laptop batteryACER TravelMate 4320 Laptop battery

Carmina said...

This program sound really amazing I'm so exciting about it because it is excellent and I hope that it would have the popularity that you're waiting in the market. Generic Viagra Viagra Online Viagra

Sam said...

Hi Everybody,
Really this is very excellent stuff found here.... I enjoyed your blog... it's very interesting... Thanks for the share.... online kamagra

贝贝 said...

The Tax Return Crack-Up<3>
Granted, there are usuallyMicrosoft Office 2010write-ups when presidential contenders make their tax returns available, but the coverage falls far short of the Office 2010
full court press (pardon the pun) that the Clintons have received. What's Microsoft Office 2007different now?Office 2007One possibility is that most upper middle class Democrats, and therefore most Microsoft OfficeOffice 2007 keyeditors and reporters of our nation's big papers as well as Office 2007 downloadtelevision producers, are Obama supporters who think that Hillary should hurry up Office 2007 Professionaland drop out of the race already.Microsoft outlook
Microsoft outlook 2010Whom elite liberals are pulling for really does shape political coverage in ways

niub520 said...

wow great i have read many articles about this topic and everytime i learn something new i dont think it will ever stop always new info , Thanks for all of your hard work!forex bulletproof

Steve said...

Look… here I am I have tried out things in the same manner as you described and guess what!!! I have been successful in taking up the challenge and fulfilling the endeavor finally!!! There cannot be anything better than this.

Caverta | Penegra

KONA said...

interesting read

ehic

mark said...

best organic seo servicesYour blog is definitely worth a read if anyone comes across it. Im lucky I did because now Ive got a whole new view of this.

KONA said...

good info

red kitchenaid mixer

KONA said...

cool read

feathered hair extensions

Ryan said...

Whenever i see the posting like yours i find myself that there are however helpful friends that share information and facts for the assistance of others it must be helpful for other artists. thanks plus excellent work.best organic seo services

sorna said...

Thanks for sharing, I will bookmark and be back again



Scrum Process

mark said...

drug forumI'm still learning from you, but I'm trying to achieve my goals. I certainly enjoy reading all that is posted on your blog.Keep the information coming. I loved it!

iori said...

I really enjoy simply reading all of your weblogs. Simply wanted to inform
you that you have people like me who appreciate your work. Definitely a great
post. Hats off to you! The information that you have provided is very helpful.

Natural supplements

Adim said...

I like this post a lot and it contains a lot of great points and obsessions!

Ready-Made Education Logo

Hannah bolton said...

It’s a great site to see. That will help for improvisation of me. Will definitely marked as Bookmark.
business broadband providers



Mark Rainmanmark said...

I liked your article, I will share your article to everyone!!




RS gold|Diablo 3 Gold|Buy WOW Gold|WoW Gold

ali khan said...

Wonderful ! Story is very moving and real ,each friend will be moved once they read it ,write more pleasemirza maqbool | Maqbool mirza

ali khan said...

Excellent tips. Really useful stuff. Never had an idea about this will look for more of such informative posts from your side. Good job Keep it up.cabs in w2 | cab w2 | w2 taxis

ali khan said...

This is the first time I've read such a good article, really very good,I hope there still can continue to taxis in w2 | minicab to airport | airport drop w2

Shelia Smithson said...

We acknowledge D3 Gold which for me personally it comes down to the only irritating section of the video game : Irrrve never by no means loved simply jumping - but it's a new summary experiencing and in addition towards the sport will not force hopsáren not necessarily, you can take action in addition.

somnus11258 said...

What a beautiful dragonfly and what wonderful post!!I am a china tour lover,You can learn more: China tour operator | China tour packages | China city travel

Manohar singh said...

I am hoping the same high-grade website post from you in the future as well. In fact your creative writing skills has inspired me to get my own blog going now. Really blogging is spreading its wings and growing rapidly. Your write up is a great example. Bridal saree