The last post in this blog (handy link below) discussed my predictions for the payments market in 2017. The payments industry is large, quite diverse from a capabilities standpoint while being lucrative from a revenue standpoint.
Why is that?
First, payments are both an essential daily function for consumers and corporates alike which means a constant annual growth in transaction volumes. Volumes are the very lifeblood of the industry.
Second, thanks to the explosion of technology capabilities especially around Smartphones & Smart Apps – the number of avenues that consumers can use to make payments has virtually surged.
Thirdly, an increasing number of developing economies such as China, India and Brazil are slowly moving over massive consumer populations over to digital payments from previously all cash economies.
Finally, in developed economies – the increased regulatory push in the form of standards like PSD2 (Payments Systems Directive 2) have begun blurring boundaries between traditional players and the new upstarts.
All of these factors have the Payments industry growing at a faster clip than most other areas of finance. No wonder, payments startups occupy pride of place in the FinTech boom.
The net net of all this is that payments will continue to offer a steady and attractive stream of investments for players in this area.
Big Data Driven Analytics in the Payments Industry..
Much like the other areas of finance, the payments industry can benefit tremendously from adopting the latest techniques in data storage and analysis. Let us consider the important ways in which they can leverage the diverse and extensive data assets they possess to perform important business functions –
Integrating all the complex & disparate functions of Payments Platforms
Most payment providers offer a variety of services. E.g. credit cards, debit cards and corporate payments. Integrating different kinds of payment types – credit cards, debit cards, Check, Wire Transfers etc into one centralized payment platform. This helps with internal efficiencies (e.g collapsing redundant functions such as fraud, risk scoring, reconciliation, reporting into one platform) but also with external services offered to merchants (e.g. forecasting, analytics etc).
Detect Payments Fraud Big Data is dramatically changing that approach with advanced analytic solutions that are powerful and fast enough to detect fraud in real time but also build models based on historical data (and deep learning) to proactively identify risks.
Risk Scoring of Payments in Realtime & Batch
Payment Providers assess the risk score of transactions in realtime depending upon various attributes (e.g. Consumer’s country of origin, IP Address etc). Big Data enables these attributes to become granular by helping support advanced statistical techniques to incorporate behavioral (e.g. transaction is out of normal behavior for a consumers buying patterns), temporal and spatial techniques.
Detect Payments Money Laundering (AML)
A range of Big Data techniques are being deployed to detect money laundering disguised as legitimate payments.
Understand Your Customers Better
Payment providers can create a single view of a Cardholder across multiple accounts & channels of usage. Doing this will enable cross sell/upsell and better customer segmentation. The below picture says it all.
Payment providers have been sitting on petabytes of customer data and have only now began waking up to the possibilities of monetizing this data. An area of increasing interest is to provide sophisticated analytics to merchants as a way of driving merchant rewards programs. Retailers, Airlines and other online merchants need to understand what segments their customers fall into as well as what the best avenues are to market to each of them. E.g. Webapp, desktop or tablet etc. Using all of the Payment Data available to them, Payment providers can help Merchant Retailers understand their customers better as well as improve their loyalty programs.
Cross Sell & Up Sell New Payment & Banking Products & Services Most payment service providers are also morphing into online banks. Big Data based Data Lakes support the integration of regular banking capabilities such as bill payment, person-to-person payments and account-to-account transfers to streamline the payments experience beyond the point of sale. Consumers can then move and manage money at the time they choose: instantly, same-day, next-day or on a scheduled date in the future
Delivering the best possible highly personalized Payments Experience Mobile Wallets offer the consumer tremendous convenience by Data Lakes support the integration of capabilities such as bill payment, person-to-person payments and account-to-account transfers to streamline the payments experience beyond the point of sale. Consumers can then move and manage money at the time they choose: instantly, same-day, next-day or on a scheduled date in the future
As we have discussed in previous posts in this blog, the payments industry is at the cusp (if not already, in the midst) of a massive disruption. Business strategies will continue to be driven by technology especially Big Data Analytics. Whether this is in Defense (cut costs, optimize IT, defend against financial crimes or augment existing cyber security) or playing Offense (signing up new customers, better cross sell and data monetization) – Big Data will continue to be a key capability in the industry.
Strata Data Conference New York – Powering business outcomes with data science
The annual Strata Data Conference will make its next stop in New York the week of September 25-29. The core theme of the conference this year is around driving business transformations through the power of data. And in the world of data, few topics excite as much as data science, machine learning, and deep learning.…
Top 5 Use Cases of HDF Streaming Analytics Manager
With the explosion of the Internet of Things (IoT), businesses need to reevaluate their existing data strategies and adopt a more modern data architecture. Building a near-real time streaming application that take advantage of data-in-motion can be a daunting journey to undertake. Most streaming applications require a considerable amount of coding, testing and time to…
Hospitality and the Big Data Window Shopping Problem
What eventually drives us to purchase something online? This isn’t a hypothetical or philosophical question, as businesses are forced to find answers every day. Consumers across every industry have access to almost anything they can find on a search engine, however with such a big supply of goods, businesses must manage the Big Data that’s…
How the Leading Transportation Tech Provider Conquers Every Mile, Including the Last - Part 2
Last week we published a story on how the leading transportation tech provider is able to solve the last mile problem for the carrier industry. This article expands on this and how companies need to have clean data. How Clean Is Your Data? By now, we all know that data is Big. We know that…
This guest blog is from our partner Denodo who is a leader in data virtualization and a Hortonworks partner for many years. Denodo helps customers who have data from multiple, heterogeneous sources to quickly, easily and cost-effectively integrate it to derive business insights and positively change their strategy to become more data-driven. In addition to…
The world is moving faster than ever before, and companies are finding themselves scrambling to keep up. Our society has become centered on convenience and everything happening in real time. Data insights need to happen in real time as well so that companies can maximize their ability to better serve their customers. Last week I…
How the Leading Transportation Tech Provider Conquers Every Mile, Including the Last - Part 1
In many industries, the last mile problem is the most difficult problem to crack. This is especially true in the carrier industry, where 91% of the total carriers operate fleets of six vehicles or less. TMW Systems (TMW) solves the last mile problem, and an array of other transportation and business challenges, by consolidating the…
GDPR Compliance Presents New Business Opportunities
The General Data Protection Regulation (GDPR) is creating new business opportunities by making it easier for companies worldwide to operate throughout the European Union. GDPR compliance will force companies to review their data-handling practices, and to analyze and understand their customer data types. Now, the conversation is changing from the burden of compliance to the…
Thank you for reading part 1 of a 2 part series for how to update Hive Tables the easy way. This is part 2 of the series. Managing Slowly Changing Dimensions In Part 1, we showed how easy it is update data in Hive using SQL MERGE, UPDATE and DELETE. Let’s take things up a notch…
Apache, Hadoop, Falcon, Atlas, Tez, Sqoop, Flume, Kafka, Pig, Hive, HBase, Accumulo, Storm, Solr, Spark, Ranger, Knox, Ambari, ZooKeeper, Oozie, Phoenix, NiFi, HAWQ, Zeppelin, Atlas, Slider, Mahout, MapReduce, HDFS, YARN, Metron and the Hadoop elephant and Apache project logos are either registered trademarks or trademarks of the Apache Software Foundation in the United States or other countries.