Testing types and important quality attributes to be considered

Functional Testing.

  • Data Integration Testing
  • Extract,Transform & Load  and Quality Test (ETL)
  • Data Repository Testing
  • Data Analytical layer Testing
  • Pre-Hadoop validation Testing
  • Reports Testing
  • Map Reduce Layer  Testing
  • Data Warehouse Testing
  • Source Verification Testing
Non-Functional Testing:
  • Performance Testing
  • Security Testing
  • Load Testing
  • Failover Testing
  • Reliability Test/Long duration Test
  • Velocity Testing
  • Testing Enviroment and Infrastructure Testing
  • Compliance and Industry standard Testing
To verify data quality we need to test at each entry  and exit point of Big data E2E pipeline

LOAD SOURCE:
  • Pre Load process validation
  • ETL process validation
  • Validate input data file
  • Security Test
  • Performance test
  • Validate Data Requirement
  • Validate Business logic  nodes
PERFORMANCE MAP REDUCE 
  • Data quality Testing
  • Validate output data file Testing
  • Validate Agrregation and Consilidation
  • Validate Data Integration
  • Validate Transformation Rule
  • Validate Data Accuracy
EXTRACT OUTPUT
  • Reports Testing
  • Cube Testing
  • Dashboard Testing
E2E Testing across various platform including Hadoop, MongoDB, Oracle, Terabite, Amazone using big flat files and XML


Comments

Post a Comment

Popular posts from this blog

How to calculate maximum number of concurrent users using littile law formula

When load testing an application, the first set of tests should focus on measuring the maximum throughput. This is especially true of multi-user, interactive applications like web applications. The maximum throughput is best measured by running a few emulated users with zero think time. This means that each emulated user sends a request, receives a response and immediately loops back to send the next request. Although this is artificial, it is the best way to quickly determine the maximum performance of the server infrastructure. Littile Law: Once you have that throughput (say X), we can use  Little’s Law  to estimate the number of real simultaneous users that the application can support. In simple terms, Little’s Law states that : N = X  / λ where N is the number of concurrent users,  λ is the average arrival rate and X is the throughput. Note that the arrival rate is the inverse of the inter-arrival time i.e. the time between requests. To under...
Read more

How to develop a security test strategy

What do you need to write a security test plan? The folowing documents comprise the list of what I would expect as inputs to the creation of the individual security test plans. This is a good point to go and review your overall security delivery plan. Does it include these documents as deliverables? Does the supplier have any of these as standard off-the-shelf products? : System security requirements System threat model System risk model Secure coding standards Technical threat modelling Infrastructure secure configuration guides Security defect metrics What is in a security test plan? The security test strategy should as a minimum specify the following points as the core content for each of the security test plans: What are the inputs to the test plan? When in the process does this test occur? Who specifies the test plan contents? Who performs the test? How many instances of the test are expected? What are the required outputs of the test? What are the success...
Read more

Singleton Design Pattern using Page Factory

Image
n this tutorial, We will learn about the  Framework Design Pattern using singleton class  in Selenium. In the Previous tutorial we have seen, How can we run the Test using Page Factory. Now question is, Will we repeat the Browser invoke and Logger code again and again in each and every Test. No, To resolve this issue we will use the Singleton Pattern. We will design the Single  Test Base  class.  First, Let's see what is  Singleton Pattern .  With the Singleton design pattern you can: Ensure that only one instance of a class is created Provide a global point of access to the object In  TestBase  class, we will Design the Singleton Pattern, We will write the command code here and all Test Classes will inherit this  TestBase  class.  n previous Example, we have seen we were invoking  WebDriver   instance  in each @Test. Here, We will Implement the WebDriver initializat...
Read more