tag:blogger.com,1999:blog-1898577169084576082024-03-14T12:58:14.563+01:00Lanciaux Maxime | BI | DWH | Hadoop | DevOps | Google Cloud | DataOps | PostgreSQLPostgreSQL, BI, DWH, Hadoop, DevOps, DataOps, Machine Learning, Cloud and others topics !Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.comBlogger236125tag:blogger.com,1999:blog-189857716908457608.post-36257217268132408652021-03-30T19:03:00.005+02:002021-03-31T19:58:59.150+02:00An image is sometimes better than a long story !<p> </p><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhuPTiUqfyq5mUalhbyeo376r7Swalk5e5-AQmdsscHpRYbm00ZzyRe6k7u-34gX6dDXtqVeMjplI1elaUCOFDdaUjEfRWzkynsYy1U4JPNDBsQicEuUx9_XNsKAHTXUh2H0UD42JYbCwXb/s2048/Screenshot+2021-03-30+at+18.59.54.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="1080" data-original-width="2048" height="338" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhuPTiUqfyq5mUalhbyeo376r7Swalk5e5-AQmdsscHpRYbm00ZzyRe6k7u-34gX6dDXtqVeMjplI1elaUCOFDdaUjEfRWzkynsYy1U4JPNDBsQicEuUx9_XNsKAHTXUh2H0UD42JYbCwXb/w640-h338/Screenshot+2021-03-30+at+18.59.54.png" width="640" /></a></div><br /><p></p>Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0tag:blogger.com,1999:blog-189857716908457608.post-83766217201774962082020-11-16T11:30:00.005+01:002020-11-18T19:43:47.192+01:00Data Mesh on Google Cloud Platform (and this is excellent !)<p></p><div class="separator" style="clear: both; text-align: left;">Hello from Home 🏡,</div><div class="separator" style="clear: both; text-align: left;"><br /></div><div class="separator" style="clear: both; text-align: left;">Quick update as I am leading the creation of a new Deck explaining Data Mesh Architecture and why this is an amazing opportunity to adopt Google Cloud Platform for this approach :</div><div class="separator" style="clear: both; text-align: left;"><ul style="text-align: left;"><li>GCP Project per Data Domain / Team (<-> direct Data Mesh mapping 👌)</li><li>Serverless</li><li>Pay as you go</li><li>Google APIs</li><li>Looker (esp. Looker API and the semantic layer)</li><li>Scalability</li><li>BigQuery / Cloud Storage / Cloud Pub/Sub</li><li>Ephemeral Hadoop cluster (Dataproc)</li><li>IAM</li><li>Cloud Source Repositories / Cloud Build</li></ul><div>This [new] architecture is not a huge revolution (and this is great), it comes from 40+ years of data platform innovation and it follows the same approach as Microservice / Kubernetes.</div><div><br /></div></div><div class="separator" style="clear: both; text-align: left;"><br /></div><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiBmbwRBBnbZ0lpfW_dRwgx1lmYhTENaEItGoeJ5s_P_1Yy2nmsZNdXtcZ9tHAEHxgNhEVpaMwhspoCSi15gRs-APYGc5hCI36OpJ8o0hb-vaNHS7vpU9AUCtsOXO4m6LTdTx6-Hp8b5pfN/s2048/Screenshot+2020-11-16+at+10.56.16.png" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="1056" data-original-width="2048" height="330" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiBmbwRBBnbZ0lpfW_dRwgx1lmYhTENaEItGoeJ5s_P_1Yy2nmsZNdXtcZ9tHAEHxgNhEVpaMwhspoCSi15gRs-APYGc5hCI36OpJ8o0hb-vaNHS7vpU9AUCtsOXO4m6LTdTx6-Hp8b5pfN/w640-h330/Screenshot+2020-11-16+at+10.56.16.png" width="640" /></a></div><div class="separator" style="clear: both; text-align: left;"><br /></div><div class="separator" style="clear: both; text-align: left;">Stay Data Mesh tuned !</div><p></p>Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0Vanves, France48.822484 2.28840520.512250163821157 -32.867845 77.132717836178841 37.444655tag:blogger.com,1999:blog-189857716908457608.post-21004015510299236362020-04-08T09:41:00.001+02:002020-04-08T23:33:02.117+02:00Google Cloud Data Management Update<div dir="ltr" style="text-align: left;" trbidi="on">
Few update this week :<br />
<br />
<ul style="text-align: left;">
<li><a href="https://cloud.google.com/blog/products/databases/fully-managed-memorystore-for-memcached">Powering up caching with Memorystore for Memcached</a></li>
<li><a href="https://cloud.google.com/blog/products/databases/nosql-cloud-database-1-or-2-nodes">Same Cloud Bigtable database, now for smaller workloads</a></li>
<li><a href="https://cloud.google.com/blog/products/databases/cloud-database-monitoring-for-bigtable">Improved database performance data: Key Visualizer now in Cloud Bigtable console</a></li>
</ul>
<div>
<a href="https://cloud.google.com/blog/products/databases">Stay</a> <a href="https://cloud.google.com/release-notes">tuned</a> !</div>
</div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0Vanves, France48.822484 2.28840548.8015745 2.2480645 48.843393500000005 2.3287455tag:blogger.com,1999:blog-189857716908457608.post-54754865882733962442020-03-29T18:43:00.002+02:002020-04-09T20:36:19.981+02:00Stay safe ! <div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;">
Good luck to you and your family during this strange period.</div>
<div class="separator" style="clear: both; text-align: center;">
<br /></div>
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi7YkdCwZMFaU4xYdn94iXhWrA3hDOhNwnI3-M1aVtx8pdtuIXuZhp5MqBrZ3vYKLuaNNtfXuzM3LICz4aNvllr-raTfMLdUcMrYvo4Mo8A_1cTzLTEK7a-Do6g2eB4qncbAbf0-CyWomR6/s1600/Yao+%2526+Maxime%252C+Marinie%25CC%2580re+%255Bblog%255D.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="1000" data-original-width="1600" height="200" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi7YkdCwZMFaU4xYdn94iXhWrA3hDOhNwnI3-M1aVtx8pdtuIXuZhp5MqBrZ3vYKLuaNNtfXuzM3LICz4aNvllr-raTfMLdUcMrYvo4Mo8A_1cTzLTEK7a-Do6g2eB4qncbAbf0-CyWomR6/s320/Yao+%2526+Maxime%252C+Marinie%25CC%2580re+%255Bblog%255D.png" width="320" /></a></div>
<div class="separator" style="clear: both; text-align: center;">
</div>
<div class="separator" style="clear: both; text-align: center;">
</div>
<div class="separator" style="clear: both; text-align: center;">
</div>
</div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0Vanves, France48.822484 2.28840548.8015745 2.2480645 48.843393500000005 2.3287455tag:blogger.com,1999:blog-189857716908457608.post-18165947170584739832020-03-15T15:33:00.001+01:002020-03-31T13:57:05.827+02:00How to DataOps with Google Cloud Platform !<div dir="ltr" style="text-align: left;" trbidi="on">
<h3 style="text-align: left;">
What do we want to achieve ?</h3>
<div>
Use DataOps to monitor information from twitter about Google.</div>
<div>
<ul style="text-align: left;">
<li>Without doing IaaS (Infrastructure), so using Google Cloud managed service or Serverless Technologies</li>
<li>Making sure all asset are stored in a repository with dev and master branch</li>
<li>No manual step to test or push content to our Google Cloud Project</li>
<li>Ensure I can adapt to data structure change and so replay all data processing from scratch</li>
<li>Keep all data and compress them</li>
</ul>
</div>
<h3 style="text-align: left;">
What do we need :</h3>
<ul style="text-align: left;">
<li>use a repository, let's try <a href="https://cloud.google.com/source-repositories">Cloud Source Repository</a> (private git hosted by Google Cloud)</li>
<li>schedule basics tasks : <a href="https://cloud.google.com/scheduler">Cloud Scheduler</a> (for more complex pipeline we have another option : <a href="https://cloud.google.com/composer">Cloud Composer</a>)</li>
<li>Act on commit to the [dev] branch : <a href="https://cloud.google.com/cloud-build">Cloud Build</a></li>
<li>Send message between task : <a href="https://cloud.google.com/pubsub">Cloud Pub/Sub</a></li>
<li>React on event or notification : <a href="https://cloud.google.com/functions">Cloud Function</a></li>
<li>Store information between tasks : <a href="https://cloud.google.com/datastore">Cloud Datastore</a></li>
<li>Read / Write data to multiple sources & targets : <a href="https://cloud.google.com/dataflow">Dataflow</a></li>
<li>Use the best fully Serverless Datawarehouse : <a href="https://cloud.google.com/bigquery">BigQuery</a></li>
<li>Monitor technical / business / FinOps related information : <a href="https://marketingplatform.google.com/about/data-studio/">Data Studio</a>, <a href="https://cloud.google.com/stackdriver">Stackdriver</a></li>
</ul>
<h3 style="text-align: left;">
Let's do it !</h3>
<div>
<ol style="text-align: left;">
<li>Schedule a task every minute to gather tweets from twitter API then store information to GCS</li>
<li>Schedule a task every day to compress all previous data in a tar.gz file </li>
<li>Read compress archive and load it to BigQuery with adaptive schema capabilities</li>
<li>Build the according reporting</li>
</ol>
<div>
More information and <a href="https://github.com/mlanciau/DataOpsDemo">code</a> soon !</div>
</div>
</div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0tag:blogger.com,1999:blog-189857716908457608.post-38220157716662206792019-09-21T10:15:00.000+02:002019-09-21T10:45:35.831+02:00How to DataOps with Google Cloud Platform !<div dir="ltr" style="text-align: left;" trbidi="on">
Hello from Budapest,<br />
<br />
It's a long time since I didn't have the chance to look at my blog, so little news, I will now restart to share here and the first topic gonna be DataOps on Google Cloud Platform using <a href="https://cloud.google.com/bigquery/">BigQuery</a>, <a href="https://datastudio.google.com/navigation/reporting">DataStudio</a>, <a href="https://jenkins.io/">Jenkins</a>, <a href="https://cloud.google.com/stackdriver/">StackDriver</a>, <a href="https://cloud.google.com/storage/">Google Cloud Storage</a> and more !<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjr4rTevzS0UTExe2HF0skkT4-01CT43ZoEvVYpIYU_GiJlMtykWGGE7HdO0W3eMbhtfuvLJmjshxbsolEipBTe_VF5qy_JPQI89Yw9ob1jdrYbr0TyDyWzXblmeTWPlM2pVdcOrVbJ4_bo/s1600/Dataops.gif" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="201" data-original-width="276" height="145" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjr4rTevzS0UTExe2HF0skkT4-01CT43ZoEvVYpIYU_GiJlMtykWGGE7HdO0W3eMbhtfuvLJmjshxbsolEipBTe_VF5qy_JPQI89Yw9ob1jdrYbr0TyDyWzXblmeTWPlM2pVdcOrVbJ4_bo/s200/Dataops.gif" width="200" /></a></div>
<br />
<br />
Stay Data tuned !</div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0Budapest, Hongrie47.497912 19.04023499999993947.154509499999996 18.394787999999938 47.8413145 19.68568199999994tag:blogger.com,1999:blog-189857716908457608.post-5689799302151042542018-05-30T06:35:00.000+02:002018-08-02T18:54:03.168+02:00Getting Things Done<div dir="ltr" style="text-align: left;" trbidi="on">
Hello from Langkawi,<br />
<br />
A quick one before boarding, I had the chance to work at several customers using several technologies on several environments and several versions... Thing skeeps changing / evolving especially when customer and / or management is changing priorities or bugs occurs on Production (can happen with Hadoop).<br />
<br />
How to keep track of your tasks (from customer questions, to admin / expense tasks, to private item to achieve) ? I tried different ways from emails, post-it, Wunderlist, Trello, Google keep and the only that worked for me is <a href="https://en.todoist.com/">Todoist</a>.<br />
<br />
Why ?<br />
<ul style="text-align: left;">
<li>Easy to setup recurring tasks</li>
<li>Karma / Graph view to see number of tasks achieved per day / per week</li>
<li>You can assign a color to each project and also create hierarchy of project</li>
<li>Possible to share with another user a project</li>
</ul>
<div>
Hope it will help ;-)</div>
<div>
Cheers<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiPDG5m0CSUL1x7WqlYbs553m0a4qvQZCQDSe-lre05X072gO5iw_aGKLcjrsA3cPhIJp5u-olRmiVK30NnspJ9OkQNv6DUuY0MIFYGNvN7e06oGPqkwBIf84Qmrdv4vDJbbaXRNznMBfWI/s1600/Capture.PNG" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="1110" data-original-width="1053" height="320" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiPDG5m0CSUL1x7WqlYbs553m0a4qvQZCQDSe-lre05X072gO5iw_aGKLcjrsA3cPhIJp5u-olRmiVK30NnspJ9OkQNv6DUuY0MIFYGNvN7e06oGPqkwBIf84Qmrdv4vDJbbaXRNznMBfWI/s320/Capture.PNG" width="303" /></a></div>
<br /></div>
</div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0Langkawi, 07000 Langkawi, Kedah, Malaisie6.35 99.799999999999955-19.172034500000002 58.491405999999955 31.872034499999998 141.10859399999995tag:blogger.com,1999:blog-189857716908457608.post-5358854589762445162018-05-07T15:27:00.002+02:002018-05-07T15:27:44.976+02:00Photo #24 !<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhamkwacqtJuR1yetJd97bUBL_nJ8BXtkn6BUs5RbQqvnJ7wLUOfWfYk4EME65zlPum3YKkOsTBGQ3veCHxs_68etZPUr_-bSeD_I6XTJutz9Du4xCOkHyHeMMTw_iqmEAIjIomp2OFtDxh/s1600/2017-08-23+14.37.37.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="1200" data-original-width="1600" height="240" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhamkwacqtJuR1yetJd97bUBL_nJ8BXtkn6BUs5RbQqvnJ7wLUOfWfYk4EME65zlPum3YKkOsTBGQ3veCHxs_68etZPUr_-bSeD_I6XTJutz9Du4xCOkHyHeMMTw_iqmEAIjIomp2OFtDxh/s320/2017-08-23+14.37.37.jpg" width="320" /></a></div>
<br /></div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0Aérodrome de Cambrai - Niergnies, 59400 Niergnies, France50.1407211 3.263657400000056450.1305446 3.2434874000000566 50.1508976 3.2838274000000562tag:blogger.com,1999:blog-189857716908457608.post-17402899442197179522017-12-12T20:09:00.001+01:002017-12-12T20:10:27.778+01:00While on holidays in SF ! With big lov from CA !<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgfKaYLy9ihD4lqJh90rT3WDo1omnEdL4AmUvDQik9RT8MyChemATWplx8LmqqgvXCW_iD0DprBzZvLgUblfpO63GHi-0ajoWngyKC6md7XR1A16azSBj8zoUwxImNAJMS3Gn5tmJgXC05z/s1600/Capture.PNG" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="537" data-original-width="1600" height="212" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgfKaYLy9ihD4lqJh90rT3WDo1omnEdL4AmUvDQik9RT8MyChemATWplx8LmqqgvXCW_iD0DprBzZvLgUblfpO63GHi-0ajoWngyKC6md7XR1A16azSBj8zoUwxImNAJMS3Gn5tmJgXC05z/s640/Capture.PNG" width="640" /></a></div>
<br /></div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0San José, Californie, États-Unis37.3382082 -121.8863286000000136.933999199999995 -122.53177560000002 37.7424172 -121.24088160000001tag:blogger.com,1999:blog-189857716908457608.post-9223807251999629352017-07-18T22:10:00.001+02:002017-07-18T22:10:59.571+02:00Photo #23 !<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiWblTygnpls39rZrDFtMjdKwxjfGPvD1CjxtS0NGTSaNDTA3HN2GyNf8jWowfh-fjct3U91JCa9bU7nfWePaAhnW9t1fzD10Hp_p4TWkxg6fyu0WX7U_-QCpIjKtULBB-rvNCz5cDdDn8m/s1600/19023522_1288937837898405_409232970912249607_o.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="1184" data-original-width="888" height="320" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiWblTygnpls39rZrDFtMjdKwxjfGPvD1CjxtS0NGTSaNDTA3HN2GyNf8jWowfh-fjct3U91JCa9bU7nfWePaAhnW9t1fzD10Hp_p4TWkxg6fyu0WX7U_-QCpIjKtULBB-rvNCz5cDdDn8m/s320/19023522_1288937837898405_409232970912249607_o.jpg" width="240" /></a></div>
<br /></div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0Le Touquet-Paris-Plage, France50.521276 1.590675000000032950.440495 1.429313500000033 50.602057 1.7520365000000329tag:blogger.com,1999:blog-189857716908457608.post-9542966198412274812017-04-05T11:10:00.001+02:002017-04-05T11:10:19.621+02:00DevOps tools !<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgwvBbEUtlAgIAsSoVniFYW4quTLtY0YNaNQ3VayhHpTCi2xVGE-jWVZP9e5AAZ4qyAJd8m1H29aleQfJBPl_5PNphxTrAylxm4QEu9OdI7RNGMSNX_fN4oKyZMi3a3YsHsTMGiDAzee1FU/s1600/DevOps+all+picture.jpeg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="225" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgwvBbEUtlAgIAsSoVniFYW4quTLtY0YNaNQ3VayhHpTCi2xVGE-jWVZP9e5AAZ4qyAJd8m1H29aleQfJBPl_5PNphxTrAylxm4QEu9OdI7RNGMSNX_fN4oKyZMi3a3YsHsTMGiDAzee1FU/s400/DevOps+all+picture.jpeg" width="400" /></a></div>
<br /></div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0tag:blogger.com,1999:blog-189857716908457608.post-73006521406047317272017-03-20T09:06:00.002+01:002017-03-20T09:06:55.538+01:00Chief DevOps Officer ! #automation<div dir="ltr" style="text-align: left;" trbidi="on">
This is the new trendy job, this is what I think his/her mission should be :<br />
<br />
<ul style="text-align: left;">
<li>Automation using DevOps</li>
<li>Improving metrics gathering & reporting</li>
<li>Quality improvement by Pareto</li>
</ul>
</div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0La Défense, France48.8897359 2.241842799999972248.879295899999995 2.2216727999999724 48.9001759 2.262012799999972tag:blogger.com,1999:blog-189857716908457608.post-63625747981288090092017-03-05T08:12:00.001+01:002017-03-05T08:12:49.556+01:00Photo #22 !<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiBLzoHiPl_rWQOJli6QdEI2HSGW4KDQjuc3_7YJf8ireENeYvxB_MjhSC9cOj6Ji_pFScwQ7URoVFFBgv21a0bauOs7oScDUop1VZtUlW560wZJUTdLvjXPrVnESGuQsF24X9Fxt-Ah3Sc/s1600/17097342_1190578451067678_8479693846009510911_o.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="320" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiBLzoHiPl_rWQOJli6QdEI2HSGW4KDQjuc3_7YJf8ireENeYvxB_MjhSC9cOj6Ji_pFScwQ7URoVFFBgv21a0bauOs7oScDUop1VZtUlW560wZJUTdLvjXPrVnESGuQsF24X9Fxt-Ah3Sc/s320/17097342_1190578451067678_8479693846009510911_o.jpg" width="240" /></a></div>
<br /></div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0San Diego, CA, USA32.715738 -117.1610838000000331.861779000000002 -118.45197730000002 33.569697000000005 -115.87019030000003tag:blogger.com,1999:blog-189857716908457608.post-88704847589982990742017-03-03T09:33:00.002+01:002017-03-03T09:33:42.405+01:00NetData !<div dir="ltr" style="text-align: left;" trbidi="on">
Very cool tool to monitor your lovely servers : <a href="https://my-netdata.io/">NetData</a> ! #Enjoy #Thanks</div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0tag:blogger.com,1999:blog-189857716908457608.post-43678052081811033612017-03-01T14:41:00.000+01:002017-03-01T14:41:57.153+01:00Hadoop & DevOps ! #FullAutomation<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhWsdZ77t5xX5k5JT1vhsR50YLz-ssTriW_1u-OVOk96dgINC-sZXc4xMbsBnN6eOYMEmE2kjd2ch0F1rxt4M-BI38feobC14xfjncHhLF4hqTC0KcoQejMTT0-BX-snNAjb73m2IGTTFhO/s1600/C5xmZRxWAAEyRWS.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="240" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhWsdZ77t5xX5k5JT1vhsR50YLz-ssTriW_1u-OVOk96dgINC-sZXc4xMbsBnN6eOYMEmE2kjd2ch0F1rxt4M-BI38feobC14xfjncHhLF4hqTC0KcoQejMTT0-BX-snNAjb73m2IGTTFhO/s320/C5xmZRxWAAEyRWS.jpg" width="320" /></a></div>
<br /></div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com041 Quai du Président Roosevelt, 92130 Issy-les-Moulineaux, France48.8339194 2.265642599999978327.3527064 -39.042951400000021 70.3151324 43.574236599999978tag:blogger.com,1999:blog-189857716908457608.post-84161966530031243572017-02-27T17:30:00.002+01:002017-02-27T17:30:10.018+01:00Be ready for tomorrow prez #hadoop #devops !<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh80YBWXHB-lmNbw57sY7TdxhW0A0Vg1wry7w7PmtrNR9U1V4lDj0AYy23Dcsw7oRbemfIolxfdDey4hT4F8a5y2OLNjcHmtahyphenhyphenTscKMn7Gdxw5uIUZ5fayTj-eE4-WEVrBxe4SefJoCC26/s1600/17016809_1185655261559997_4456931151401638791_o.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="180" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh80YBWXHB-lmNbw57sY7TdxhW0A0Vg1wry7w7PmtrNR9U1V4lDj0AYy23Dcsw7oRbemfIolxfdDey4hT4F8a5y2OLNjcHmtahyphenhyphenTscKMn7Gdxw5uIUZ5fayTj-eE4-WEVrBxe4SefJoCC26/s320/17016809_1185655261559997_4456931151401638791_o.jpg" width="320" /></a></div>
<br /></div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0La Défense, France48.8897359 2.241842799999972248.879295899999995 2.2216727999999724 48.9001759 2.262012799999972tag:blogger.com,1999:blog-189857716908457608.post-91027733441127869592017-02-10T11:31:00.001+01:002017-02-10T12:23:38.922+01:00Monitoring Hadoop application deployment per environment #DevOps !<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjTtz34jaRSswHIPE8y8SCsuWdJ4BGOvXIo1dwFIny2UrLBOhu48mBjzmfBivWmgkZJgo9Mc8aTaJsQXqwtqKekVKwfKT70a4s89yBy2Z3RhtPZ4anwMebMTI-fWfJWgmwIFuC2t1eCJVsO/s1600/Screenshot+2017-02-10+11.30.48.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="101" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjTtz34jaRSswHIPE8y8SCsuWdJ4BGOvXIo1dwFIny2UrLBOhu48mBjzmfBivWmgkZJgo9Mc8aTaJsQXqwtqKekVKwfKT70a4s89yBy2Z3RhtPZ4anwMebMTI-fWfJWgmwIFuC2t1eCJVsO/s320/Screenshot+2017-02-10+11.30.48.png" width="320" /></a></div>
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgjx6xUsld7xkxnfewXDxzCTgCFyPhiSbvbp5IQga9kmS_39I9u0isooC4ME1oKnPg0ujcd8k9x0ZgoYaiczNTIw2mhDybMUAddtpgY_ZtTJJ_hmy_BncWksuxyE5ZapcPyva25jyVUK3__/s1600/Screenshot+2017-02-10+11.31.14.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="88" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgjx6xUsld7xkxnfewXDxzCTgCFyPhiSbvbp5IQga9kmS_39I9u0isooC4ME1oKnPg0ujcd8k9x0ZgoYaiczNTIw2mhDybMUAddtpgY_ZtTJJ_hmy_BncWksuxyE5ZapcPyva25jyVUK3__/s320/Screenshot+2017-02-10+11.31.14.png" width="320" /></a></div>
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhYRPYSlVD7RK-mxNaKec4XxfaO4lDAh-fOYXt_q1RB6Ge0EK3gd-6xL6CC72Dloa5jZyqkIWanBxRYWPpp5MxnLBk3Fyc-gjxAti-PejXMUmHgiccLAQsK3OCUENjZ9DMXDd1cPm8gSURC/s1600/Screenshot+2017-02-10+11.31.42.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="84" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhYRPYSlVD7RK-mxNaKec4XxfaO4lDAh-fOYXt_q1RB6Ge0EK3gd-6xL6CC72Dloa5jZyqkIWanBxRYWPpp5MxnLBk3Fyc-gjxAti-PejXMUmHgiccLAQsK3OCUENjZ9DMXDd1cPm8gSURC/s320/Screenshot+2017-02-10+11.31.42.png" width="320" /></a></div>
<br /></div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0tag:blogger.com,1999:blog-189857716908457608.post-9720221219619427332017-01-09T21:04:00.001+01:002017-01-09T21:04:05.771+01:00Open source <div dir="ltr" style="text-align: left;" trbidi="on">
A fantastic Open Source Tableau like reporting and data exploration tool to look at : <a href="http://airbnb.io/superset/">Superset</a> from the fantastic ladies and gentlemen from <a href="https://github.com/airbnb/superset">Airbnb</a>.</div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0San Diego, Californie, États-Unis32.715738 -117.1610838000000331.861779000000002 -118.45197730000002 33.569697000000005 -115.87019030000003tag:blogger.com,1999:blog-189857716908457608.post-27824241311721972532016-10-14T11:22:00.001+02:002016-10-14T11:22:09.385+02:00This guy is a genius !<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;">
<iframe width="320" height="266" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/8aJw4chksqM/0.jpg" src="https://www.youtube.com/embed/8aJw4chksqM?feature=player_embedded" frameborder="0" allowfullscreen></iframe></div>
<br /></div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0tag:blogger.com,1999:blog-189857716908457608.post-69894100651965077242016-10-14T10:39:00.000+02:002016-10-14T10:39:52.750+02:00Enjoying Ambari View !<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj0bkt0m9Cz_5llN3Sh-dsB1_iRjPl5jvuqZl6wp16CYSW4TPX-Kiz-pJzqnGLtYnIavvXf_Itc5R_GHFGJU2rTEqvuNRTRq7uUi7nTq0xr3ED7ya0SH8g_r8B2dbdXGc6-qJC9Ji_liFXB/s1600/image001.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="355" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj0bkt0m9Cz_5llN3Sh-dsB1_iRjPl5jvuqZl6wp16CYSW4TPX-Kiz-pJzqnGLtYnIavvXf_Itc5R_GHFGJU2rTEqvuNRTRq7uUi7nTq0xr3ED7ya0SH8g_r8B2dbdXGc6-qJC9Ji_liFXB/s640/image001.png" width="640" /></a></div>
<br /></div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0Paris, France48.856614 2.352221900000017748.6894645 2.0294984000000178 49.0237635 2.6749454000000177tag:blogger.com,1999:blog-189857716908457608.post-52649513393167294762016-10-12T07:08:00.002+02:002016-10-12T07:08:28.804+02:00How to install Ansible on Ubuntu !<div dir="ltr" style="text-align: left;" trbidi="on">
<span style="background-color: black; color: white; font-family: Courier New, Courier, monospace;">sudo apt-get install software-properties-common</span><br />
<span style="background-color: black; color: white; font-family: Courier New, Courier, monospace;">sudo apt-add-repository ppa:ansible/ansible</span><br />
<span style="background-color: black; color: white; font-family: Courier New, Courier, monospace;">sudo apt-get update</span><br />
<span style="background-color: black; color: white; font-family: Courier New, Courier, monospace;">sudo apt-get install ansible</span></div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0tag:blogger.com,1999:blog-189857716908457608.post-15011375315473375072016-10-03T06:03:00.003+02:002016-10-03T06:07:43.747+02:00A normal process while doing automation #enterpr1se 3.0 !<div dir="ltr" style="text-align: left;" trbidi="on">
Every time you want to automate an IT process :<br />
<ul style="text-align: left;">
<li>Look for <a href="https://en.wikipedia.org/wiki/Pareto_principle">Pareto</a></li>
<li>Create the according test</li>
<li>Set up quality control / performance metrics and dashboards</li>
<li>Gather the logs</li>
<li>Configure backups</li>
<li>Ensure the code / configuration is pushed to the configuration management tool</li>
<li>Be sure to be compliant with your security</li>
</ul>
</div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0tag:blogger.com,1999:blog-189857716908457608.post-91642609022828926312016-10-03T05:57:00.001+02:002016-10-03T05:57:33.089+02:00What is DevOps ?<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;">
<iframe width="320" height="266" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/_I94-tJlovg/0.jpg" src="https://www.youtube.com/embed/_I94-tJlovg?feature=player_embedded" frameborder="0" allowfullscreen></iframe></div>
<br /></div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0tag:blogger.com,1999:blog-189857716908457608.post-61414361170727176532016-09-26T16:00:00.000+02:002016-09-26T16:00:04.348+02:00I find your lack of automation disturbing !<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiqHShBPtPXaHlrcyu6Woqsw9rllRKWTbVa32yJgwfqCF3LuYtR_Ek42nrsID7f8P_c65j5YTWxJt4MMqzbObKWyShuo_PnUz_Cl4xOwtg0oSTGvOlsGsOi5biNvoaGvyHUmtL1MVo-EFOD/s1600/Ifindyourlackofautomationdisturbing.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="256" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiqHShBPtPXaHlrcyu6Woqsw9rllRKWTbVa32yJgwfqCF3LuYtR_Ek42nrsID7f8P_c65j5YTWxJt4MMqzbObKWyShuo_PnUz_Cl4xOwtg0oSTGvOlsGsOi5biNvoaGvyHUmtL1MVo-EFOD/s320/Ifindyourlackofautomationdisturbing.jpg" width="320" /></a></div>
<br /></div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0tag:blogger.com,1999:blog-189857716908457608.post-73442297497902392702016-09-25T11:59:00.001+02:002016-09-25T11:59:34.241+02:00The fourth UI you need to enjoy your Hadoop cluster !<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjbk1ggOun4JOpU55MIg2FQJIzyFVA273YLquOSsG1dg7rdvJCoh6fAbAZosJo5Y-HCbMBipLsqBfG8O0MDkHJAMIRVsaiMFOGkFLT_Lt7KZy6Fkv17DxttLyO_BvvUSdKdYAKIWt1C80Am/s1600/Screenshot+2016-09-25+11.56.27.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="400" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjbk1ggOun4JOpU55MIg2FQJIzyFVA273YLquOSsG1dg7rdvJCoh6fAbAZosJo5Y-HCbMBipLsqBfG8O0MDkHJAMIRVsaiMFOGkFLT_Lt7KZy6Fkv17DxttLyO_BvvUSdKdYAKIWt1C80Am/s640/Screenshot+2016-09-25+11.56.27.png" width="640" /></a></div>
<br /></div>
Maxime Lanciauxhttp://www.blogger.com/profile/15720191466214228401noreply@blogger.com0Ivry-sur-Seine, France48.813055 2.388220000000046648.771229 2.3075390000000464 48.854881 2.4689010000000469